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Abstract 

^^ I The spectrum of a first-order logic sentence is the set of natural numbers that are 

^ i cardinalities of its finite models. This notion has been shown to be closely linked with 

• ' complexity theory. In fact, asking whether the spectra of first-order logic sentences is 

fj . closed under complement is equivalent to asking whether NE = CO-NE. 

In this paper we show that when restricted to using only two variables, the spectra of 

first-order logic sentences are closed under complement. In particular, we show that they 

►^ ' are semilinear. At the heart of our proof are semilinear characterisations for the existence 

^\ . of regular graphs, the class of graphs in which there are a priori bounds on the degrees of 

CN ' the vertices. 

oo ■ 

p 

T:t ; 1 Introduction 

O 

^^ Descriptive complexity is the study of complexity theory via the methods of mathematical 

logic. In essence, instead of asking how much time/space needed to check whether the input 
has a certain property p, in descriptive complexity we ask how hard it is to express property p 

/\ . in a formal language. When we use first-order logic, descriptive complexity captures exactly 

^ I the important complexity classes. (A beautiful article [5D] by Immerman in the Notices of 

AMS can serve as a gentle introduction to the topic. See also [3l \2T\ [26] for some well known 
texts.) 

The origin of descriptive complexity can actually be traced back to an innocent question 
asked by Scholz in [H^ when he introduced the notion of the spectrum and asked whether 
there exists a necessary and sufficient condition for a set to be a spectrum. The spectrum of a 
first-order sentence (p, denoted by Spec((/)), is the set of natural numbers that are cardinalities 
of finite models of (j). Or, more formally, Spec((/>) = {n \ there is a model of (p of size n}. A 
set is a spectrum, if it is the spectrum of a first-order sentence. 

Since its publication, Scholz's question and many of its variants have been investigated by 
many researchers for the past 60 years. One of the arguably main open problems in this area 



'This article has been submitted to arXiv.org under the same title. 



is the one asked by Asser in [Ij, known as Asser's conjecture, whether the complement of a 
spectrum is also a spectrum. 

At first glance the notion of spectrum and complexity theory have nothing to do with 
each other. Hence, it came as a surprise when Jones and Selman [22], as well as Fagin [1] 
independently showed that a set of integers is a spectrum if and only if its binary represen- 
tation is in NE. Hence, Asser's conjecture is equivalent to asking whether NE = CO-NE. 
It also immediately implies that if Asser's conjecture is false, i.e., there is a spectrum whose 
complement is not a spectrum, then NP 7^ CO-NP, hence P 7^ NP. The converse implication 
is still open. An interesting result in [37] states that if spectra are precisely rudimentary 
sets, then NE = CO-NE and NP 7^ CO-NP|j There are a number of interesting connections 
between spectrum and various models of computation such as RAM as well as intrinsic com- 
putational behavior. See, for example, [3 [lOl [TTl [271 [33] . We refer the reader to [2] for a more 
comprehensive treatment on the spectra problem and its history. 

The notion of spectra was then generalised by Fagin [3], called generalised spectra, which 
are the projective classes of Tarski restricted to finite structures. This notion is what later on 
gives birth to descriptive complexity and finite model theory [201 13 131 1211 [2S] • 

The main result in this paper. Since the original Asser's conjecture is a very difficult 
problem, it is natural then to ask whether it holds on a certain subclass of first-order logic. To 
this end, we consider the two-variable logic with counting, denoted by FO C, which is a class of 
first-order sentences using only two variables and allowing counting quantifiers 3 z <p{z), where 
A; > 1. Intuitively, 3^z (t){z) means that there exist at least k number of z's such that 4){z) 
holds. Two- variable logic and its variant is an important class of logic used in many settings in 
computer science such as verification, specification, artificial intelligence, etc [121 H^ l [3T 1 I36j. 
The class FO C itself was first introduced and studied in [U [32] . 

The following are typical instances of structures expressible in FO C(l[ 

(Ex.1) d-regular graphs: the graphs in which every vertex has degree d. 

(Ex.2) (c, d)-biregular graphs: the bipartite graphs on the vertices U UV , where the degree 
of each vertex in U and ^ is c and d, respectively. 

(Ex.3) (c, (i)-directed-regular graphs: the graphs in which the in-degree and the out-degree of 
each vertex is c and d, respectively. 

An observation from basic graph theory tells us that for "big enough" M and A^|i[ 

(CI) there is a d-regular graph of N vertices if and only if Nd is even number; 

(C2) there is a (c, d)-biregular graph in which M vertices are of degree c and N vertices of 
degree d if and only if Mc = Nd; 

(C3) there is a (c, (i)-directed-regular graph of N vertices if and only if Nc = Nd, and hence, 
c = d. 

These characterisations immediately imply that the spectra of the sentences (Ex.l)~(Ex.3) 
above are arithmetic sequences. 



*It should be noted that the class of rudimentary sets corresponds precisely to linear time hierarchy - the 
linear time analog of polynomial time hierarchy [3S] . 

^ Though the result in this paper holds for arbitrary structures, it helps to assume that the structures of 
FO'^C are graphs in which the vertices and the edges are labelled with a finite number of colours. 

'' "Big enough" means that M and N are greater than a constant K which depends only on c and d. 



In this paper we show that the spectra of FO C are semihnear sets - sets that are finite 
unions of arithmetic sequences. The main technical difficulty that we encounter here is that 
we cannot rely on any available "pumping" argument, argument which is commonly used to 
prove that a set is semilinear. Hence, we proceed by constructing a Presburger formula that 
captures the spectrum of a given formula. Since Presburger formulas are known to express 
precisely semilinear sets [8], our result follows immediately. 

The crux of our construction is a generalisation of the characterisations (C1)-(C3) above 
to the following setting. Let C be a set of ^-colors, denoted by coli, C0I2, . . . ,col£, and let 
D he an i X m-matrix whose entries are all non-negative integers. We say that a graph 
G = (V, E) is /^-regular, if we can color its edges with colors from C such that there is a 
partition V = Vi U • • • U Vm, where for every integer 1 < i < m, for every vertex v £ Vi, 
for every 1 < j < i, the number of edges with color co\j adjacent to v is precisely Dj^i. 
Our setting also allows us to say that the number of edges with color colj adjacent to v 
is at least Dj^i. In Theorem 14.11 we obtain a Presburger formula that characterises the set 
{A^ I there is a LJ-regular graph of N vertices}. In a similar manner, we can define {C,D)- 
biregular graphs and (C, L')-directed-regular graphs and obtain their respective Presburger 
formula. |=| We then proceed to observe that the relations in every model of a FO C formula 
can be partitioned in such a way that every part forms a (C, D)-directed-regular graph, and 
every two parts a (C, £))-biregular graph. Applying the Presburger formula that characterises 
the existence of these regular graphs, we obtain the semilinearity of the spectra of FO C 
formulae. 

For the converse direction, it is not that difficult to show that every semilinear set is also 
a spectrum of an FO C sentence. Since semilinear sets are closed under complement, this 
establishes the fact that the spectra of FO C are closed under complement. 

It can also be deduced immediately from our proof that the many-sorted spectra of FO C 
are also semilinear. We will define precisely many-sorted spectra in Section [2j Intuitively, 
the many-sorted spectra of a formula are spectra which counts the cardinality of the unary 
predicates in the models of the formula, instead of just counting the sizes of the models. 

Moreover, our result extends trivially to the class 350 C, the class of sentences of the 
form: 

3Ri--- 3Rm. ^, (1) 

where i?i, . . . , Rm are second-order variables and (j) uses only two first-order variables. We sim- 
ply regard Ri, . . . , Rm as part of the signature. Properties expressible in 350 C include many 
NP-complete problems such as 3-colorability and /c-clique. In fact, in descriptive complexity 
the class NP is defined precisely by 350 sentences, that is, sentences of the same form ([T|), 
but without any restriction on the number of variables in (j). 

Related works. The logic FO C is not the first logic known to have semilinear spectra. 
A well known Parikh theorem states the spectra of context-free languages are semilinear, 
and closed under complementation. Using the celebrated composition method, Gurevich and 
Shelah in [16] showed that the spectra of monadic second order logic with one unary function 



^Closely related to our result is the work by S. L. Hakimi [17] which deals with the question: given a vector 
(di, . . . , d,-n), is there a graph with vertices vi, . . . , Vm whose degrees are precisely di, . . . , dm, respectively? 
Another related result concerns the notion of score sequence obtained by H. G. Landau [23 which deals with 
the question: given a vector (di, . . . , dm), is there a tournament with vertices vi, . . . ,Vm whose outdegrees are 
precisely di, . . . ,dm, respectively? These questions are evidently different from our characterisations provided 
in Sections g] and [7] 



are semilinear. In [7] Fischer and Makowsky show that the spectra of the monadic second-order 
logic with modulo counting over structures with bounded tree-width are semihnear. 

On the other hand, structures expressible in FO C do not have bounded tree-width. An 
example is d-regular graphs for d > 3. It should also be noted that in FO C one can express 
a few unary functions, hence our result does not follow from |16j . and neither theirs from 
ours since we are restricted to using only two variables. A significant difference between our 
result and the previous ones is we do not put any restriction on the vocabulary nor in the 
interpretation. 

The result closest to ours is the one by E. Grandjean in [llj where he considers the spectra 
of first-order sentences using only one variable. A similar result due to M. Grohe and stated 
in [2], says that for every Turing machine M, there exists a first-order sentence (pM using only 
three variables such that Spec(0a/) = {^^ I i is the length of an accepting run of M}. With 
this evidence it is widely believed that every spectrum is the spectrum of a first-order sentence 
using only three variables [5], thus, making our result "almost optimal." 

It is a standard practice in logic to relate the number of variables with the intrinsic com- 
putational behaviour. See, for example, [W\ I31| . It was known that two- variable logic has 
small model property and hence decidable [30]. On the other hand, FO C does not have finite 
model property, but still decidable [141 [32] . In the context of specification and verification 
of concurrent system, two-variable logic (even without counting) is especially an important 
class [13] due to its relation to modal logic commonly used in specification and artificial intelli- 
gence. Our result and its proof give another interesting insight why modal logic is so robustly 
decidable |12[ [36] - each of its model is simply a collection of regular graphs. There is also a 
related result in [Gj [35] where it was shown how to encode in polynomial time the derivation 
trees of a context-free grammar to Presburger formula. 

Outline of the paper. This paper is organised as follows. In Section [2] we review the defi- 
nition of FO C and state our main results and a few corolarries. In Section [3] we present the 
modal logic for FO C, called quantified modal logic with counting (QIVILC). For our purpose 
it is easier to work with QIVILC than with FO C. In Sections [D and [S] we introduce the notion 
of regularity and biregularity for undirected graphs and present their Presburger characterisa- 
tions, which will then be used in Section [Bj to show the semilinearity of the spectra of FO C 
when restricted to undirected graphs. In Section [7] we introduce the notion of regularity for 
directed graphs and present their Presburger characterisations, which will then be used in 
Section [8] to prove the semilinearity of the spectra of the full FO C. Obviously, the result in 
Section [6] is subsumed in Section [8l However, we believe that it is interesting enough to be 
stated independently. Finally we conclude with some concluding remarks in Section [9l The 
details of most proofs are put in the appendix. 

2 The logic FO^C 

In this section we review the definition of FO C and mention the main result in this paper 
and its corollaries. In the following let V = {Pi,P2, ■ ■ ■} be the set of predicate symbols of 
arity 1; while TZ = {Ri,R2, • ■ ■} the set of predicate symbols of arity 2. Two- variable logic 
with counting (FO C) is defined by the following syntax. 

(j) := ^(j)\R{z,z)\P{z)\(j)iA<j)2\3''z(j) 

where the variable z ranges over x,y, R over TZ and P over V. 



The quantifier 3 z 4> means that there are at least k elements z such that (f) holds. Note 
that 3^2; (f) is equivalent to the standard 3z 4>, and Vz (f) is equivalent to -iB^z -i(/>. By default, 
we assume that 3^z cp always holds. 

For simplicity, we are going to use the following notations. 

3=''z ^ := 3^z (P A ^{3^+^z (/.) 
J^^zcj) := -^{3^+^z(l)) 

As usual, we write 21 ^ 0, if the structure 2t is a model of (j) and Model (0) = {21 | 2t |= 0}. 
Theorem 12.11 below is the main result in this paper. We present its proof is Section [8l 

Theorem 2.1 For every (j) € FO C, there exists a Presburger formula ^(x) such that the set 
{n I ^(n) holds} = SPEC{(j)). 

We should remark that Theorem 12.11 also holds for arbitrary vocabulary. Since FO C uses 
only two variables, relations of greater arity such as R{x,y,x,x,y) can be viewed simply as 
unary or binary relations; so we can create new binary and unary relations for each possible 
combination, and easily verify whether the result is consistent. 

An immediate consequence of Theorem 12.11 is the spectra of FO C(Sym) are semilinear, 
since it is known from [8] that every set expressible by Presburger formula is semilinear. 

Corollary 2.2 For every sentence (j) G FO C, the spectrum Spec((^) is semilinear. 

On the other hand, it is not that difficult to show that every semilinear set is a spectrum 
of an FO C sentence, as formally stated below. 

Proposition 2.3 For every semilinear set A C N, there exists a sentence (j) S FO C such that 
Spec((^) = A. 

Combining Corollarv 12.21 and Proposition 12.31 we obtain the following corollary. 
Corollary 2.4 The spectra of FO^C sentences are closed under complement within FO^C. 

Proof. It follows from Corollarv 12.21 and Proposition 12.31 and the fact that semilinear sets are 
closed under complement. ■ 

Theorem 12.11 can be further generalised as follows. We define the many-sorted spectrum 
as the Parikh image of the graph G, where Parikh(G) = (ni, . . . ,ni), and n^ is the number of 
nodes in G labeled with Pj. With a slight adjustment in our proof in Section [8j we can obtain 
the following corollary. 

Corollary 2.5 

• The Parikh image of the graphs satisfying a formula 4> G FO C is semilinear. 

• The following problem is decidable. Given an FO C formula (/) with V = {Pi, . . . , P/} be 
the set of unary predicates and a Presburger formula ^{xi, . . . ,xi), determine whether 
there exists a graph G G Model{<j)) such that "^{Parikh{G)) holds. 



3 Quantified modal logic with counting 

In this section we present an equivalent form of FO C, called quantified modal logic with 
counting (QMLC). For our purpose, it will be easier to work on QMLC rather than FO C 
directly. 

Moreover, for ease of presentation, we make the following assumption. Let (/) G FO C 
and let TZ and S be the set of binary and unary predicates appearing in cj), respectively. By 
extending 7^ and S and by modifying the sentence (p, if necessary, we can construct another 
(j)' € FO C such that the structures of </>' have the same sizes as those of (j) and every structure 
21 G Model (0') satisfies the following. 

• 21 is a clique over A. 

That is, for every a,b G A, either a = 6 or R(a, h) for some R £ TZ. 

• Every binary relation in TZ is not reflexive. 

That is, for every R gTZ, for every a,b G A, if R{a, 6), then a j^ b. 

• 7?- is closed under reversal. 

That is, for every R (^ TZ, there exists R gTZ such that R ^ R and for every a, 6 S j4, 
R{a, b) if and only if R (6, o). 

• The binary predicates in 7^ are pairwise disjoint. 

Note that all these assumptions can be written in FO C sentences. 

The class MLC of modal logic with counting is defined with the following syntax. 

(p ::= ^0 I a I (/>i A (/>2 I 0^(A 

where a ranges over T, and /3 over 7^. 

The semantics of MLC is as follows. Let 21 be a structure of r and a (^ A and (j) be an MLC 
formula. That 21 satisfies from a, denoted by 2t, a \= (p, is defined as followed. 

• 21, a ^ P, where P £V,ii S{a) holds in 2t. 

• 2t,a ^ ^(^, if 21, a ^ (/>. 

• 21, a ^ (/)! A 02, if 21, a ^ (/>i and 21, a \= (j)2- 

• 21, a 1= (}%4'j if there exist at least k elements 6i, . . . , 6^ € A such that R{a, hi) holds in 
21 and 21, 6j |= </> for i = 1, . . . , A:. 

We define the class of quantified modal logic with counting, denoted by QMLC with the 
following syntax. 

(j) :■= -^(j) \ (j)i A (j)2 \ 3''i^ 

where the formula ip € MLC. A QMLC formula (f) is called a basic QMLC, if it is of the form 
3^^ if, where 93 € MLC. 

The semantics of QMLC is as follows. Let 21 be a structure of r and (j) G QMLC. That 21 
satisfies 4>, denoted by 21 ^ 0, is defined as followed. 

• 21 1= -10, if it is not the case that 21 |= 0. 

• 21 ^ <?;>i A 02, if 2t ^ (/>i and 2t \= 02- 

• 21 ^ 3 '0, if there exist at least k elements ai,...,afc G A such that 21, a, \= ip for 
i = 1, . . . ,k. 



We also denote by Spec((/)), the spectrum of a QMLC formula (p. It can be shown by a 
technique similar to the one in [28] that FO C and QMLC are equivalent. (See Appendix Rl 
for the details.) 

The following notion of type will be useful. Let (/> be a QMLC(Sym) sentence. Let A4^ be 
the set of all MLC subformulae of 4> and their negations. A type in i;^ is a subset T C Jli^ such 
that 

• if 991 A 932 G T, then both ipi,ip2 G T; 

• 93 S T if and only if -k/? ^ T; 

• if ^{ifi A 992) G T, then at least one of ^(pi, -'</?2 G T. 

For a structure 21 and an element a £ A, we define the type of a in 21, denoted by type2i(a) C 
J^(f), where ^ G type(2i(a) if and only if 21, a |= 99. For a type T, we write T(2l) to denote the 
set of elements in A with type T. Note that the sets r(2t)'s are disjoint. We let T^ to be the 
set of all types in (j). 

4 Undirected regular graphs 

In this section and the next we introduce the notion of regularity and biregularity for undi- 
rected graphs. It should be noted that both classes of graphs are expressible in FO^C sentences. 
In the following N denote the set {0, 1,2,...}. 

We start with the notion of ^-type graphs. An ^-type undirected graph is a tuple G = 
{V, El, ... , E^), where Ei, . . . ,Ei are pairwise disjoint symmetric relations on V. Edges in Ei 
are called -Ej-edges. It helps to think of an ^-type graph as a graph in which the edges are 
coloured with i number of colours. We write V{G) to denote the set of vertices y in G and 
Ei{G) the set Ei, for each i = 1, . . . ,£. 

For a vertex u € V{G), degE^{u) denotes the number of Ei-edges adjacent to it, and 
deg(ti) = l^j=i deg^;. (n). We write deg(G) = max{deg(u) | u is a vertex in G}. For an 
integer d G N, we write deg^. (u) = *'d, if deg^;^ (u) > d. 

Let •'N = {n,*^,...} and B = N U ^'N. We write B^''"' to denote the set of £ x m 
matrices whose entries are from B. The entry in row i and column j of a matrix D G B ^"^ is 
denoted by Dij. An £-type graph G = (y,Ei,..., Ei) is D-regular, if there exists a partition 
y = Vi U • • • U Vm such that for each i = 1, ...,£, ior each j = 1, . . . , tti, for each vertex v G Vj, 
deg^^(i)) = -DijU We say that Fi U • • • U Vm is a partition of /^-regularity and the graph G is 
of size N = {Ni, . . .,Nm), if (A^l, • • • ,iV,n) = (|^l|, • • • , |K^|). 

Theorem 4.1 For every matrix D G B ^™', there is a Presburger formula REGd^X), where 
X = {Xi, . . . , Xm) such that the following holds. There exists a D-regular i-type graph of size 
N if and only if REGDiX) holds. 

This theorem is then generalised to the case of complete graphs. An ^-type graph is a 
complete graph, if every two of its vertices are connected by an edge. In other words, if 
G = (y,Ei,..., Eg) is a complete graph, then the graph G' = {V,EiU ■ ■ ■ U Eg) is a clique. If 
G is also a D-regular graph, then we call G a L'-regular-complete graph. 

The following theorem is the main result in this section that will be used in Section [6l 



^If Di^j = *'d, then this means deg^. (w) > d. 



Theorem 4.2 For every matrix D G B ^™, there is a Presburger formula REG-COMPd^X), 
where X = (Xi, . . . ,Xm) such that the following holds. There exists a D -regular- complete 
graph of size N if and only if REG-COMPd{N) holds. 

5 Undirected biregular graphs 

In this section we introduce the notion of biregularity for undirected bipartite graphs. An i- 
type bipartite graph is a tuple G = {U, V,Ei,..., En), where -Ej C [/ x F, for each i = 1,. . . ,L 
Let C G B^^'" and D £ B^^". An i-type bipartite graph G = {U,V,Ei, . . . , Ee) is {G, D)- 
biregular , if there is a partition [/ = C/i U • • • U Um and V = ViiJ- ■ -yjVn such that the fohowing 
holds. 

• For every i = 1, ...,£, for each j = 1, . . . ,77i, for each vertex u £ Uj, deg^. (n) = Gij. 

• For every i = 1, . . . ,f, for each j = 1, . . . ,n, for each vertex v gVj, deg£;^(i)) = Dij. 

The partitions U = Ui U • • • L) Um and V = Vi U ■ ■ ■ U Vn are called the partitions of the 
(C, I?)-biregularity of G. We say that the (C, L')-biregular graph G is of size {M,N), if 
M = {\Ui\,..., \Um\) and N = {\Vi\,..., |K|). 

Theorem 5.1 For every two matrices C € B ^™ and D G B ^", there is a Presburger formula 
BiREGcni^ , Y), where X = {Xi, . . . , Xm) and Y = (Yi, . . . ,Yn) such that the following holds. 
There exists an (.-type {C,D) -biregular graph of size {M,N) if and only if BiREGcniM , N) 
holds. 

This theorem is then generalised to the case of complete bipartite graphs. An -^-type 
bipartite graph G = (C/, V,Ei,..., En) is complete, if the graph G' = (C/, V,Ei\J ■ ■ ■ U E() is 
a complete bipartite graph. If G is also a (C, D)-biregular graph, then we call it a (C, D)- 
biregular-complete graph. 

The following theorem is the main result in this section that will be used in Section [6l 

Theorem 5.2 For every two matrices C G B ^"^ and D G B ^", there is a Presburger for- 
mula BiREG-COMPc,DiX,Y), where X = {Xi, . . .,Xm) and Y = (Yi, . . . ,Yn) such that the 
following holds. There exists a (G, D) -biregular- complete graph of size [M,N) if and only if 
BiREG-COMPc,D{M,N) holds. 



6 Proof of Theorem 12.11 on undirected graphs 



In this section we are going to prove Theorem 12.11 when the interpretations are restricted 
on undirected graphs. We denote by FO C(Sym) the subclass of FO C formula when all the 
binary relations are assumed to be symmetric. We let QI\/lLC(Sym) to be its equivalent QMLC 
counterpart. 

Obviously the semilinearity of the spectra of FO C(Sym) is only a special case of Theo- 
rem 12.11 Nevertheless, we believe that it is sufficiently interesting to be stated on its own 
especially since it uses a separate tool developed in Section HI and the Presburger formulae 
constructed for both FO^C(Sym) and FO^C are slightly different. Not surprisingly the formula 
for FO C(Sym) is simpler since it can "disregard" the orientation of the edges. 

In the remaining of this subsection we are going to present the construction of the desired 
Presburger formula for QMLC(Sym) formula (p. We start with basic QI\/lLC(Sym) formulae. 
Recall that a QMLC formula (^ is a basic QMLC, if it is of the form 3^ ip, where ip G MLC. 



Proposition 6.1 For every basic QMLC(Sym) formula (p, there exists a Preshurger formula 
PREB^{x) such that Spec(<?;>) = {n \ PREB^{n) holds}. 

Proof. Let (/) be of the form: 3^^ 93. Let TZ = {Ri, . . . ,Ri} to be the set of binary relations 
used in (p. Let K be the integer such that for every subformula Oj^ip in (p, we have I < K. 

Recall the notion of type introduced in Section [3] and that T^ is the set of all types in (p. 

A function / : T^p x 7^ x T^p — )• {0, 1, . . . , K} U \*'K} is consistent, if for every T G T<^ 
the following holds. 

. If OU e ^> then Y.S s.t. 59M /(^' ^' S) ^ ^■ 

. If -(Ok /^) G r, then Y.S s.t. 59M /(^' ^, 5) < ^ - 1- 

Intuitively a consistent function is to indicate that the semantics of each type is obeyed. More 
precisely, it is intended to mean that for an element a of type T there are /(T, R, S) number 
of i?-edges going from the element a to elements of type S. Let T = {/i, . . . , fm} be the set 
of all consistent functions. 

For a type T G Ts, we define the matrix Dt S B^^™ as follows. 



Dt 



( fi{T,R^,T) f2{T,Ri,T) 
fi{T,R2,T) f2iT,R2,T) 



fn,{T,Ri,T) \ 

fUT,R2,T) 



\fiiT,Re,T) f2iT,Re,T) ••• fmiT,Re,T)J 
For two different types S,T G Ta,, we define the matrix Ds^t € B ^"^ as follows. 



Ds~^T 



( fiiS,Ri,T) f2{S,Ri,T) 
fiiS,R2,T) f2iS,R2,T) 



f„,{S,Ri,T) \ 

fm{S,R2,T) 



\fi{S,R,,T) f2{S,Ri,T) ••• fm{S,Ri,T) J 



Now we define the formula PREB0(x). First, we enumerate the set T<^ = {Ti, . . . , r„} and the 
set T(h X J" = {(Ti, /i), . . . , (r„, fm)}- The formula PREB(a(2;) is defined as follows. 



3^{Ti,/i) • • • 3^(T„,/™) 2; 



^ Y^ Xt^j^ a PREB-Atom^(X) A CON(X) 

l<i<n l<J<»Ti / 



where X = (X^^j'^j^-^, . . . ,X('p^j^)) the vector of all the variables X^j-j^'s and 



X(^Tj) > k 



PREB-Atom^(X) := ^ 

{T,f) s.t. v^eT 

CON(X) := /\ REG-C0MPi5^(XT) A /\ B\REG-COMPDs^T,DT^si^s,XT) 



TgT 



S,TeT 



where Xt = {X(^T,h), ■ ■ ■ ,XiTj^)) and X5 = (Xf^sji), ■ ■ ■ ,^{Sjm)) the vector of variables 
associated with the types T and S, respectively. 

We claim that PREB,;!, defines precisely the spectrum of (p. Intuitively, the meaning of the 
variable Xj-j is the number of elements of type T in which there exists /(T, R, S) number of 
i?-edges going to elements of type S. The formula CON is to make sure that the values for 



Xtj's are consistent, that is, they obey the intended meaning of T and /; while PREB-Atom,;!, 
is to make sure that the original QMLC formula (p is satisfied. The details can be found in 
Appendix El ■ 



Proposition 6.2 Let cf) € QMLC(Sym) be a negation of a basic QMLC formula. Then there 
exists a Presburger formula PREB(j){x) such that Spec(0) = {n \ PREB^{n) holds}. 

Proof. The proof is almost the same as in the proof of Proposition 16. II Let (p be -'3 ^p, where 
if G MLC. We simply replace the formula PREB-Atom with ^/^ ^s^ ^j, ^(t,/) < k — 1. 
This completes our proof of Proposition 16.21 ■ 



Theorem 6.3 For every (p € FO C(Sym), there exists a Presburger formula PREB(p[x) such 
that the set {n \ ^(n) holds} = SPEC{(p). In particular, the spectra of FO C(Sym) sentences 
are closed under complement within FO C(Sym) itself. 

Proof. Let (p € FO C(Sym). We may assume that (p is a QI\/lLC(Sym) formula. Now the proof 
of Theorem 16.31 is a straightforward generalisation of Propositions 16.11 and 16.21 We simply 
redefine PREB-Atom,^ as follows. First, we push all the negations inside that they are only 
applied to basic QMLC(Sym). 

We redefine PREB-Atom^ inductively as follows. 



If 
If 
If 
If 



3^ip, then PREB-Atom,^ := J2{T,f) s.t. ^gt ^{tj) > k. 
-'3''ip, then PREB-Atom^ := E(t,/) s.t. •per ^(Tj) < k - 1. 
(pi A (/>2, then PREB-Atom,^ := PREB-Atom^^ A PREB-Atom^j. 
01 V (/>2, then PREB-Atom,^ := PREB-Atom^^ V PREB-Atom^^. 



Now the formula PREB(^(x) is defined exactly like above. 

3^m,/,)---3^(T„,/™) (^= E E ^T,,/, ) A PREB-Atom^(X) A CON(X) 

\ l<i<n l<j<m J 

where the formula CON is as in Proposition 16.11 The correctness of the formula PREB(^(3;) 
can be verified by a straightforward induction. 

On the other hand, it is not that difficult to show that every semilinear set is a spectrum of 
an FO C(Sym) sentence, hence the spectra of FO C(Sym) is closed under complement within 
FO C(Sym) itself. This completes our proof of Theorem 16.31 ■ 



7 Directed regular graphs 

In this section we introduce the notion of regularity for directed graphs. 

An £-type directed graph is a tuple G = {V,Ei, . . . ,E(), where Ei, . . . ,Ei are pairwise 
disjoint irrefiexive relations re on V and for every u,v (zV, ii {u,v) G £^1 U • • • U Ei, then the 
reverse direction {v,u) ^ EiU ■ ■ ■ L) E^. Edges in Ei are called £^j-edges. 

We will write in-deg^.(n) to denote the number of incoming Ei-edges toward the vertex 
u, and out-degg. (i() to denote the number of outgoing £^j-edges from the vertex u. As before, 
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for an integer d G N, we write m-deg^-iu) = *'d and out-deg^;. (u) = *'d, to indicate that 
in-deg^;. (n) > d and in-deg^;^ {u) > d, respectively. 

Let ^'N = I*"!, *^,...} and B = N U ^'N. We write B^""" to denote the set of i x m matrices 
whose entries are from B. The entry in row i and column j of a matrix Z) € B ^™ is denoted 
by Dij. 

Let C,D £ B^'^™. An £-type directed graph G = (y,Ei, . . . , Ei) is (C, L'j-directed-regular, 
if there exists a partition y = ViU- • -UVm. such that for each i = 1, . . . ,i, for each j = 1, . . . ,m, 
for each vertex v gVj, in-deg^;^ (t;) = Cij and out-degg^ (?;) = Dij. 

We say that Fi U • • • U Vm is a partition of (C, Z?) -regularity and the graph G is of size 
N = (iVi, . . .,Nm), if (A^i, . . . ,iV^) = (iFil, . . . , \V^\). 

Theorem 7.1 For every C, Z? G B ^™, i/iere exists a Presburger formula Dir-REGc,D{X), 
where X = {Xi, . . . , Xm) such that the following holds. There exists a (C, D)-directed-regular 
i-type graph of size N if and only if Dir-REGc,D{X) holds. 

An ^-type graph G = {V,Ei, . . . ,E£) is a complete directed graph, if every two vertices 
u, V, either (n, v) or {v, u) is in i^i U • • -UE^. By the standard graph theoretic term, a complete 
directed graph is a tournament with coloured edges. If G is also a D-regular graph, then we 
call G a D-directed-regular-complete graph. 

Theorem 7.2 For every C,D e B^^'", there is a Presburger formula Dir-REG-COMPc,D{X) 
such that the following holds. There exists a D-directed-regular- complete graph of size N if 
and only if Dir-REG-COMPc,D{N) holds. 

8 Proof of Theorem [23] 

In this section we are going to prove Theorem 12 . 1 1 using the tools developed in Sections [5] and [71 
Recall that a QMLC formula (/> is a basic QMLC, if it is of the form 3 ip, where (p € MLC. 

Proposition 8.1 For every basic QMLC formula (p, there exists a Presburger formula PREBfp{x) 
such that Spec(0) = {n | PREB^{n) holds}. 

Proof. Let (j) be of the form: 3'^ 93. Let TZ = {Ri, ■ ■ ■ , Re, Ri, . . . , Ri} be the set of binary 
relations used in cp and that Ri is the reversed relation of Ri. Let K be the integer such that 
for all subformula OjjV' in 4': we have I < K. 

Recall the notion of type introduced in Section [3] and that T<^ is the set of all types in 
(p. Recall also the notion of consistent function / : T^ x TZ x T,f, — >■ {0, 1, . . . , K} U \*'K} 
introduced in the proof of Proposition 16.11 which for convenience, we repeat here. A function 
/ is consistent, if for every T G T,^ the following holds. 

. If 0^ /i G T, then Y.T' s.t. T'^^. fi^, R, T') > I. 

. If -(0^ ^) G T, then ^^, ^, ^,^^ f{T,R,T') < / - 1, and f{T,R,T') € N, for every 
R £ TZ and for every type T' 3 fj.. 

Let T = {/i, . . . , /m} be the set of all consistent functions. 

For a type T G T^,, we define two matrices Dt, Ut G B ^™ as follows. 



Dt 



( fi{T,Ri,T) f2{T,Ri,T) ••• fm{T,Ri,T)\ 

fi{T,R2,T) /2(r,i?2,T) ••• fm{T,R2,T) 

V /i(r,i?,,T) f2{T,Re,T) ■■■ f^{T,Re,T) J 
11 



and 



^T ■■= 



/ fi{T,ti,T) h{T,%,T) ••• fm{T,%,T)\ 
fi{T,%,T) f2{T,%,T) ••• fm{T,%,T) 



,Ri, 



\ h{T,1le,T) h{T,1ie,T) ••• U{T,%,T) ) 

Intuitively, the matrix Dt collects all the information of the degrees of the relations Ri 
while Dt the degrees of the reverse relations Ri, . . . , Ri. 

For two different types S,T £ Ttj,, we define the matrix Dg^x, T^g^x S IB ^"^ as follows. 

/ fi{S,RuT) f2{S,Ri,T) ■■■ U{S,Ri,T) \ 
fiiS,R2,T) f2{S,R2,T) ■' - - 



Ds- 



and 



^ 



S-^T 



fi{S,Re,T) f2{S,Re,T) 
MS,%,T) f2iS,1iuT) 
h{S,%,T) f2iS,%,T) 



( hiT,1ii,S) f2{T,%,S) 
fiiT,%,S) f2{T,%,S) 



fi(,T,li,,S) f2{T,Ri,S) 
fi{T,Ri,S) f2{T,Ri,S) 
h{T,R2,S) f2{T,R2,S) 



fm{S,R2,T) 

fm{S,R£,T) 
fm{S, Rl,T) 
fm{S, R2,T) 



U{S,1ie,T) I 



fmiT,Ri,S) \ 

fm{T, R2,S) 

U{T,%,S) 

fm{T.,Rl,S) 
frn{T,R2,S) 



V h{T,Re,S) f2{T,Ri,S) ■■■ fm{T,Re,S) ) 

Notice that in the matrix Dg^x the first £ rows contains the information on the degree of 
Ri, . . . ,Re, and the last i rows the information on the degree of Ri, . . . , Re from the type S 
to the type T; while in the matrix Dg^x it is the opposite and the direction is from the type 
T to the type S. 

Now we define the formula PREB(^(x). First, we enumerate the set 7",^ = {Ti, . . . ,T„} and 
the set T^ X T = {(Ti, /i), . . . , (T„, fm)}- The formula PREB^(x) is defined as follows. 



3^(Ti,/i) • • • 3^(T„,/„) X 



Y^ Y^ Xx^j^ A PREB-Atom<^(X) A CON(X) 

\ l<i<n l<i<m / 

where X = {X(^Xiji)i ■ ■ ■ ^-^iT^Jm)) ^^^ vector of all the variables X(2-j)'s and 

PREB-Atom^(J^) := ^ 

(T,/) s.t. veT 

and 

CON(X) := A Dir-REG-COMP ^ (Xx) 



Xixj) > k 



T&T 



A /\ /\ BiREG-COMP^^^^jj^^_^(XT.,XT, 

l<i<n l<i<i-l 



'I '^j' ^i '^] 
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where Xt = {X^tJi), ■ ■ ■ ,X(^Tjm)) and Xs = {X^sji), ■ ■ ■ ,X{SJ,^)) the vector of variables 
associated with the types T and S, respectively. 

Notice in the formula BiREG-COMP^ ^ {XTi,XT) the direction is always from 

Ti to Tj whenever i > j + 1. 

We claim that PREB,;!, defines precisely the spectrum of <j). The proof is rather similar to 
the one in Proposition 16. II We simply observe that the incoming Ri edges to an element v are 
precisely the outgoing Ri edges from v. Vice versa, the outgoing Ri edges from an element v 
are precisely the incoming Ri edges to v. The details can be found in Appendix [Hi ■ 

Similar to Proposition 16. 2| one can show the following. Let (j) E QMLC be a negation of 
a basic QMLC formula, say -'3^^, where ip € MLC. Then there exists a Presburger formula 
PREB0(x) such that Spec((/>) = {n \ PREB0(n) holds}. We can achieve this by replacing the 
formula PREB-Atom above with X^c^^ f) st weT -^(tj) 1^ k — 1. 

To prove Theorem l2.1| we simply run through the same argument as in Theorem 16.31 Let 
(j) G QMLC. Push all the negations inside so that they are applied only to basic QMLC and 
redefine PREB-Atom(i inductively as follows. 



3''ip, then PREB-Atom,^ := E(t,/) s.t. .^eT ^(tj) > k. 
-'3''ip, then PREB-Atom^ := E(t,/) s.t. •per ^(Tj) < k - I. 
01 A (/>2, then PREB-Atom,^ := PREB-Atom^^ A PREB-Atom^j. 
01 V 02, then PREB-Atom,^ := PREB-Atom^^ V PREB-Atom^j. 

Now the formula PREB(^(x) is defined exactly like above. 



If 
If 
If 
If 



3^m,/0---3^(T„,/™) h^= E E ^T.,/, A PREB-Atom^(X) A CON(X) 

\ l<i<n l<j<m / 

where the formula CON is as in Proposition 18.11 The correctness of the formula PREB(f,{x) 
can be verified by a straightforward induction. This completes our proof of Theorem 12.11 

9 Concluding remarks 

By showing Presburger formulas for the existence of regular graphs, we have shown that the 
spectra of FO C formulae are constructive semilinear sets. From our proof, it can be im- 
mediately deduced that the many-sorted spectra of FO C are also semilinear. As far as our 
knowledge is concerned, the logic FO C is the first logic whose spectra is closed under comple- 
ment without any restriction on the vocabulary nor in the interpretation. The semilinearity of 
its spectra also gives us an interesting insight on the nature of two-variable logic - that each 
of its models is simply a collection of regular graphs. 

Another interesting open question is, how can be FO C extended while keeping decidabil- 
ity? Using three variables (FO C) one can easily encode a grid; therefore, the Parikh images 
no longer are decidable. However, we could extend FO C by giving access to a relation having 
a property which is undefinable in FO C, such as transitivity. In particular, FO C(<), that 
is, the logic FO C with access to a total order on the universe, seems powerful: Petri net 
reachability \29 \ 1241 E5] reduces to Parikh image membership for FO C(<). We do not know 
whether a reduction exists in the other direction. Another possible extension is to add an 
equivalence relation to FO^C. 
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APPENDICES 
A The equivalence between FO C and QMLC 

Let (f> S FO^C and let 7?. and S be the set of binary and unary predicates appearing in (f), 
respectively. The construction of the QMLC formula for (/) is as follows. 

1. Convert the sentence ip into its "normal form" (/>'1UJ 

2. Convert the sentence (p' into a "quantified modal logic" (QMLC) sentence if such that 
for all structure 21, we have 21 |= (/>' if and only if 21 ^ y?. 

We remark these steps are simply adaptation of the technique in [28] . 

The sentence (f) ^ FO C is in normal form, if all the quantifiers are either of form 



3''y (^R{x,y)A^{y) 

or of form 

B^'x ipix) 

and all other applications of variables are of form ai{x). 

We claim that every sentence ip ^ FO C can be converted into its equivalent sentence in 
normal form. It can be done as follows. 

• First, we rewrite every subformula of the form 3^y '>p{x, y) with one free variable x into 
the following form: 



ip{x,x) A 3^= ^y {{x^y)^1p{x,y)^ 



V 



3 



^y (^{xy^y)Aip{x,y) 



After such rewriting, we can assume that every quantifier in (j) is of the form 3 y {{x ^ 
y) A'ip{x,y)). 

Second, every quantification 3^y ((^ 7^ v) ^i^ix^y)), in which ijj{x,y) contains a subfor- 
mula a{x) depending only on x, can be rewritten into the form: 



^a(x) A 3^y \^{x ^ y) Ai;o{x,y) 

V 
a{x) A 3^y (^(x / y) A '0i(x,y)j 



where ipo{x,y) and ij)i{x,y) are obtained from ■0 by replacing a{x) with false and true, 
respectively. We can repeat this until il:{x, y) no longer has a subformula depending only 
on x. 
After such rewriting we can assume that every quantifier in (j) is of the form 

3^y {{x^y)Aij{x,y)), 

where ip{x,y) does not contain any subformula depending only on x. 



"We would like to remark that the normal form here is different from the standard Scott's normal form. 
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Third, every quantification 3^y ( (x 7^ y) A ip{^: u) ) can be rewritten into the form: 



where A^ is the set of all function / : 7?. — ?• N such that YIr^tz /(-^) = ^) ^'^d ipR{y) is 
obtained from ^'(s^) v) by replacing each i?'(x, y) with true if i? = i?', and false otherwise. 

By performing these three steps, we get an FO C formula in the normal form. 

Now given an FO C sentence (j) in its normal form, the construction of its QMLC sentence 
^l^ = F{(l)) can be done inductively as follows. There are two cases. 

1. (f) has no free variable. 

• If is ^(^1, then F{4>) = ^F{4>i). 

• If is 01 A 02, then F{(j)) = F(0i) A F(02). 

• If is 3*-x 01 (x), then F(0) = 3^F(0i(3;)). 

2. has one free variable x. 

• If 0(x) is S{x), then F(0(x)) = S. 

• If 0(x) is 0i(x) A 02(x), then F(0(x)) = F(0i(x)) A F(02(x)). 

• If 0(x) is -01 (x), then F(0(x)) = -F(0i(x)). 

• If 0(x) is B'^y R{x, y) A ip{x, y), then F(0(x)) = ()'l^F{Tp{x, y)). 

The case when has one free variable y can be handled in a symmetrical way. 



By a straightforward induction, we can show that for every structure 21, 21 |= if and only if 
2t \= F{(j)). This concludes the conversion from the normal forms of FO C to QMLC formulae. 

B Proof of Theorem 14.11 

For convenience, we repeat Theorem 14.11 here . 

Theorem 14.11 For every D G M ^"^, there exists a Presburger formula REGd^X), where 
X = {Xi, . . . , Xm) such that the following holds. There exists a D-regular i-type graph of size 
N if and only if REGAIN) holds. 

The essence of the theorem lies on the case when D € N^^'". This is what we will consider 
first for the sake of presentation. The proof is divided into three successive steps. 

(1) First, we consider the simplest case when D £ N^^^ in Subsection lB.il 

(2) Then we generalise it to the case I? G N^^"^ in Subsection IB. 21 This is done by induction 
on m. 

(3) Finally we consider the case of arbitrary D G p^^x™ in Subsection IB. 31 This is done by 
induction on i. 

When D contains an element of B, it will be easier since there is more freedom in adding more 
edges. However, the proof will be more tedious. For this reason, we postpone the case when 
D contains an element of B until Subsection IB. 41 
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B.l When D e N^^^ 

In this subsection we deal with the case when D consists of only one entry d S N. This means 
that the degree of every vertex is the same. For convenience, we will simply write d-regular 
graphs, instead of a more cumbersome notation (d)-regular graph. 

We have the following proposition which appears to be a folklore in the graph theory. We 
present the proof here since we are going to need it. 

Proposition B.l Let d > 0. Then, for every N > 0, the following holds. 

(a) There exists a d-regular graph of size N if and only if N > d+1 and the product dN is 
an even number. 

(b) If the product Nd is an odd number and N > d+1, then there is a graph of size N in 
which there is exactly one vertex with degree d—1, and all the other N — 1 vertices have 
degree d. 

Proof. Let d > 0. We first prove item (a). The "only if" direction is straightforward. If a 
d-regular graph has size A^, then N > d+ 1. Moreover, the product dN is precisely twice the 
number of edges, hence, an even number. 

The "if" direction is as follows. Let iV > d + 1 and the product dN is an even number. 
There are two cases. 

• If d is even, then we construct a d-regular graph G = {V, E) with N vertices as follows. 
Let V = {vq, . . . ,vn-i}- For each vi G V , we put an edge between Vi and each of the 
vertices v-d. . . . , fi_i, Uj+i, . . . , v-,d. (Here the minus and plus are on modulo N .) It 

'2 ^"''2 

is obvious then that every vertex has degree d. 

• If d is odd, then N must be even. The construction of a d-regular graph of size A^ is as 
follows. First, we construct a (d — l)-regular graph G' = (y,E') of size N. (Since d is 
odd, then (d — 1) must be even.) Now every vertex has degree (d — 1). To increase the 
degree of each vertex by one, we can do the pairing between two vertices as follows. Let 
V = {fo, . . . , vn~i}- For each < i < N/2 — 1, we add a new edge between the vertex 
Vi and its partner UAr/2+i- (Note that N is even in this case, hence every vertex has its 
partner.) This way we obtain a d-regular graph of size A^. 

Next, we prove item (b). If A'^d is odd, then both A'^ and d are odd. Now we perform the 
construction of d-regular graph of size A'^ as in the case of odd d in item (a). But when we do 
the pairing, there is one vertex without a partner. This vertex has degree d—1, while the rest 
have degree d each. ■ 



B.2 When D e N^'^'" 

Next, we consider the case when i = 1 and m > 1, that is, when D consists of only one row 
vector d, or in other words, the graph is a 1-type graph. The proof is by induction on m with 
the basis m = 1 already settled in Proposition lB.il Since we only consider the case of 1-type 
graph, we will simply write deg{u) to denote the degree of the vertex u, instead of deg^^{u). 
We need the following notion of almost d-regular graph. For a vector d G N™, a 1-type 
graph G = {V, E) is almost d-regular graph, if there is a partition Fi U • • • U Vm of its vertices 
such that there exists exactly one j € {1, . . . , in}, where 
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• for all i 7^ j, for every vertex u G Vi, deg{u) = df, 

• there is exactly one vertex u (z Vj where deg{u) = dj — 1, and all the other vertices in 
Vj have degree dj. 

The special vertex in Vj with degree dj — 1 is called the culprit vertex. We say that the graph 
is of size N = {Ni, . . . , Nm), where (iVi, . . . , Nm) = {\Vi\, • • • , |^|)- Similar to the above, we 
call the partition Vi U • • • U Vm a partition of the almost d-regularity of the graph G. 

In the following I denotes the vector (1, . . . , 1) € N™, that is, I is a vector whose compo- 
nents are all one. Lemma lB.21 below is a generalisation of Proposition lB.il 

Lemma B.2 Let d € N™ such that it does not contain zero entry. Then, for every N such 
that N -l > (d ■ 1)"^ + (d • 1), the following holds. 

(a) If the dot product d ■ N is even, then there is a d-regular graph of size N. 

(h) If the dot product d ■ N is odd, then there is an almost d-regular graph of size N . 

Proof. The proof is by induction on m. The base case m = 1 has been established in parts (a) 
and (b) of Propositions IB.l] since d^ + 1 > (i+ 1. For the induction hypothesis, we assume 
that the lemma holds for the case of m. For the induction step, we are going to establish the 
case of m + 1. 

Let d = {di, . . . , dm+i) S N™+^ Now suppose N = (iVi, . . . , iVm+i) such that N -1 > 
{d-l)^ + d-l. 

We first prove part (a). Suppose d ■ N is even. There are two cases. 

Case 1: For all i e {1, . . . ,m + 1}, Ni > di + 1. 

In this case, by Proposition IB.li we construct the following graph Gi, for each i € 
{l,...,m + l}. 

• If Nidi is an even number, the graph Gi is a dj-regular graph of size iVj. 

• If Nidi is an odd number, the graph Gi is an almost dj-regular graph of size Ni. 

Since iV • d is an even number, there are even number of almost dj-regular graphs from 
all the Gi, . . . , G^+i. Hence, there are even number of culprit vertices, say 2k. We can 
form k number of pairs of culprit vertices and connect each pair with an edge. This way 
we obtain a d-regular graph of size N. 

Case 2: There exists i G {1, . . . ,m+ 1} such that 1 < A'^j < dj. 

Without loss of generality, we assume that Nm+i < dm+i- There are two cases: 

• Both dm+iNm+i and '^^i diNi are even. 

Since iV • 1 > (d • 1)^ + d • 1, we have Yl^i ^i ^ (Si^i '^«)^ + SI^i '^«) hence we 
can apply the induction hypothesis, from which we obtain a (di, . . . , dm)-i'egular 
graph Gi of size (iVi, . . . , Nm)- Let G2 be a clique of Nm+i nodes. We are going to 
combine Gi and G2 to obtain a d-regular graph of size N. The idea is to increase 
the degree of each node in G2 , while preserving the degree of each node in Gi . 
Each vertex in G2 has degree N^+i — 1- We have to increase it to dm+i- So 
we need (d^+i — Nm+i + 1) additional edges adjacent to each vertex in G2, or 
Nm+i{dm+i — Nm+1 + 1) cdgcs adjacent to G2 in total. 

Intuitively, we do the following. For each edge {ui,U2) € E{Gi), we choose two ver- 
tices fi,i;2 G ^(G2), delete the edge (^1,^2) and add in the edges {vi,ui), (^2,^2)- 
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We call the edges {vi,ui), {v2,U2) crossing edges between Gi and G2. See, for ex- 
ample, the graph below. The graph G2 is a clique of dm+i vertices, while Gi is the 
{di, . . . , dm)-i'egular graph of size (A^i, . . . , Nm)- Now we pick an edge (ui, U2) in 
Gi and two vertices ^1,^2 in G2 as illustrated below. 



Go 





Gi 



From the above graph, we "omit" the edge {ui,U2) and "add in" the two crossing 
edges {vi,ui) and {v2,U2)- See the illustration below. This way we increase the 
degrees of both f 1, ^2 by 1, while the degrees of both ui,U2 stay the same. 



Go 



Vl 








V2 

















Ui 



U2 



Gi 



We do this repeatedly until the degree of each vertex in G2 becomes dm+i- There 
are two things to prove here: (1) that it is possible to arrive in the situation that 
the degree of each vertex in G2 becomes dm+i] (2) there are sufficient edges in G2 
for that. 

First, we prove (1). The initial total degree of vertices in G2 is Nm+i{Nm+i — 1)) 
which is an even number. Each time we perform the operation above, we increase 
the total degree of vertices in G2 by two. Since Nm+idm+i is even, and hence so is 
the number Nm+i{dm+i — ^m+i + 1); ^^ the end we will reach the situation that 
each vertex in G2 becomes dm+i- 

Now we prove (2). We can pick ^m+i(d^+i^~Nm+i+i) ^^^^^^^^ g^^ggg ^^ q^ (j^ote that 
Nm+i{dm+i — Nm+i + 1) is an even number.) Those edges exist for the following 
reason. Since iV-1 > {d-l)'^ + d-l and N„i+i < dm+i, we have Ylii<i<m^i — (^■1)'^. 
Each of the vertex in Gi has degree < d -1. Hence, there are 



E 



l<i<m 



Ni 



(d-l) 



> 



d: 



■m+l 



> 



Nm+l{dm+l - Nm+1 + 1) 



vertices with disjoint neighbours. 

Both dm+iNm+i and EilLi diNi are odd. 

Applying the induction hypothesis, we obtain an almost (di. 



, (im)-i'egular graph 
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Gi of size (A^i, . . . ,Nm)- Let u be the culprit vertex in Gi. Let G2 be a clique of 
Nm+i nodes. Note that the sum of the degrees of vertices in G2 is Nm+i{Nm+i — !)• 
We perform similar operation as in the case above. For two vertices i^i, f2 G V{G2) 
whose degrees are < dm+i — 1, or a vertex vi = V2 whose degree is < im+i — 2, we 
pick an edge {ui,U2) S E{G2), delete it and add two crossing edges (fi,ni) and 

{V2,U2)- 

We stop the process until there is only one vertex v G V{G2) whose degree is 
dm+i — 1 and all other vertices in ^(^2) have degree dm+i- Since Nm+idm+i is 
odd number, while Nm+iiNm+i — 1) is even number, such vertex v should exist at 
the end of the process of "converting edges in Gi to crossing edges." That there are 
enough edges in E[Gi) is already established above. Now, connecting the culprit 
vertices u and v with an edge, we obtain d-regular graph of size N . 

Now we prove part (b). The proof is very similar to part (a). The only difference is that 
there should be a culprit vertex. 
There are two cases. 

Case 1: For ah i G {1, . . . , ?n + 1}, Ni>di + 1. 

In this case, by Proposition IB.li we construct the following graph Gj, for each i G 
{l,...,m + l}. 

• If Nidi is an even number, the graph Gi is a dj-regular graph of size Ni. 

• If Nidi is an odd number, the graph Gi is an almost dj-regular graph of size iVj. 

Since iV • d is an odd number, there are odd number of almost dj-regular graphs from 
all the Gi, . . . , Gm+i- Hence, there are odd number of culprit vertices, say 2k + 1. From 
the 2k culprit vertices, we can form k number of pairs of culprit vertices and connect 
each pair with an edge. Thence, we are left with one culprit vertex. This way we obtain 
an almost d-regular graph of size N . 

Case 2: There exists i G {1, . . . , ttz + 1} such that Ni < di. 

Without loss of generality, we assume that Nm+i < dm+i- There are two cases. 

• dm+iNm+i is odd and "^^i diNi is even. 

Applying the induction hypothesis, we obtain a (di, . . . , (im,)-regular graph Gi of 
size {Ni, . . . ,Nm)- Let G2 be a clique of size Nm+i- By converting an edge in 
E{Gi) into two crossing edges to increase the degrees of vertices in G2, we can 
get the degrees of all vertices in G2, but one, are dm+i, and one vertex has degree 

dm+l — 1- 

• dm+iNm+1 is even and J2^i ^iNi is odd. 

Applying the induction hypothesis, we obtain an almost {di, . . . , dm)-regular graph 
Gi of size (A''i, . . . , N^). Let G2 be a clique of size Nm+i- By converting an edge 
in E[Gi) into two crossing edges to increase the degrees of vertices in G2, we can 
get the degrees of all vertices in G2 to be dm+i- 

This competes the proof of Lemma IB. 21 ■ 

Lemma IB. 2 1 can then be easily extended to obtain a Presburger formula for the existence 
of d-regular graphs when d G N'", as stated in Theorem IB.3I below. 
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Theorem B.3 For every d € N™, there exists a Presburger formula REG^{X), where X = 
{Xi, . . . ,Xm) such that the following holds. There exists a d-regular graph of size N if and 
only if REG^{N) holds. 

Proof. The proof is a dhect application of Lemma IB.2I We assume that all the entries in d 
are not zero. We define the following set /. 

/ := {N j iV • 1 < (J • 1) + (d • 1) and there exists a J-regular graph of size N} 

Such set can be computed since the number of N such that iV • I < (d ■ 1)^ + (ti • I) is 
finite and for each N there are only finitely many graphs whose size is N. Now, we define the 
formula REGj(X) to be the following formula. 

X-l>{d-l)'^ + {d-l)A{3zX-d = 2z)] W \/ X = N 

Nei 

The formula is a Presburger formula since d are constants. That REGj(X) is the desired 
formula follows from Lemma lB.21 and the fact that if G is a ti-regular graph of size N, then 
iV • d is precisely twice the number of edges, hence an even number. 

For the case when d contains zero entries, we do the following. Suppose d = (di, . . . , dm) 
and let J = {i \ di = 0} 

REGj(X) := /\ X, >0 A REG^-,(X'), 
ieJ 

where d and X are the vectors d and X without the entries in J, respectively, and REG j' {X ) 
is defined as above. ■ 



B.3 When D e W"" 

/ Ji 
In this section we consider the case when D € f^ixm^ j^^^ £) = \ : | g N ^"^, where 

di, . . . ,de are the row vectors of D. 
We define the following set 

Id '■= {N j iV • 1 < 2i{D ■ 1)^ + 3i and there exists a C-regular graph of size N} 

Then, we define the formula REG£)(-^) inductively, where X = {Xi, . . . ,Xm) as follows. For 
simplicity, we assume that D does not contain zero column. (If column i in D is a zero column, 
we simply add Xi > and ignore the column.) 

• When £ = 1: 

REGi,(X) := REG,-^(X) 

• When £>2: 

REGd(^) := y X = N V 

NeiD 

V [x-xid,)>2iD. 1)^ + 3 A REG^„,-^,(X) A REG,-^,(X) 
i<j<e 
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where x{dj) is the characteristic vector of d\**\ and D — dj denotes the matrix D without 
row j. 

We are going to prove that for every D € N , there exists a D-regular graph of size N 
if and only if the statement REGd(-/V) holds. The proof is by induction on i. The basis i = 1 
has been established in Theorem IB. 31 For the induction step, we assume that it holds for the 
case of £ — 1 and we are going to prove the case i. 

We first prove the "only if" direction. Suppose G = {V, Ei, . . . , E() is D-regular of size N . 
If iV G Id, then REGz)(iV) holds. So suppose N ^ Id, that is, iV • 1 >_ 2^(L»_- 1)^ + 3£. Since D 
does not contain zero column, there exists j € {1, ■■-,£] such that N ■ x(4?) ^ 2(2? • 1)^ + 3. 
Moreover, if G = {V, Ei, . . . , E^) is D-regular of size N, then G is also {D — (ij)-regular and 
dj-regular. By the induction hypothesis, both REG^_j.(iV) and REGj.(-/V) hold. 

We now prove the "if" direction. Suppose REGi:)(iV) holds. U N £ Id, then there exists 
a D-regular graph of size N and we are done. So suppose N ^ Id- Hence there exists 
j € {1, . . . , ^} such that 

N-x{d,)>2{D-lf + ?, A REG^.j/iV) A REG,-^(iV) 

For simplicity, we assume that j = L By induction hypothesis, there exists a (Z? — di)-ieg\x\ai 
graph Gi = {Vi,Ei, . . . , E^^i) of size N , and by definition, Ei, . . . , E^^i are pairwise disjoint. 
By Theorem IB. 31 there exists a d^-regular graph G2 = (V2, -Bf) of size N . We can assume that 
Vi = V2 since Gi and G2 are of the same size N . 

We are going to combine G\ and G2 into one graph to get an ^-type D-regular graph 
Gi = (yi,^i,...,£;^)ofsize7V. li Ee,r\{Ei\J- ■ ■\JEe,_i) = 0, then the graph G = {V,Ei, . . . ,Ei) 
is the desired D-regular (^)-type graph of size N , and we are done. 

Now suppose El n {Ei U • • • U Ei^i) ^ 0. We are going to construct another graph 
G^ = {V, E'^) such that 



\E[r\{EiU---U E, 



i-i) 



< \Ein{EiU---UE, 



i-1) 



We do this repeatedly until at the end we obtain a graph G2 = (V^, E") such that E" D (Ei U 
■ • • U E^„i) = 0. 

Let {u,v) (z El D {El U • • • U -E^-i). The number of vertices reachable in from u and v 
within distance 2 (by any of edges in Ei, . . . , E^) is bounded from above by 2{D -1)^ + 2. Since 
N ■ xide) > '^'{D ■ 1)2 + 3, there exists (n', u') G E^ such that {u, u'), {v, v') ^ EiU---U Eg. See 
the left side of the illustration below. 




u 



GEp 




**The characteristic vector of c = (ci, . . . , Cm) £ N™ is defined as x(ci, • ■ • , Cm) := (61, ... , b,n) £ {0, lY' 
where bi = if c,; = 0, and 6i = f if c^ > f . 
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Now we define E'^ by deleting the edges {u,v),{u' ,v') from Eg, while adding the edges 
{u,v'),{u' ,v) into E£. Formally, 

E', := {Ee-{{u,v),{u',v')})U{{u,u'),{v,v')} 

See the right side of the illustration above. 

Now it is straightforward that G' = {V, E'^) is still a d^-regular graph of size N, while 



\E'i, n {El U ■ ■ ■ U Ei^i)\ < \Ein{EiU---UEi 



'1) 



We perform this operation until -B^+i n {Ei U • • • U Eg) = 0. This completes our proof when 
D G N^^™. 

B.4 When D contains elements from ^N 

In this subsection we consider the case when D contains elements from ^N. Recall that 
B = N U "N. 

We are going to use the following notations. For ^d € ^'N, we write [^dj to denote the 
number d. By default, we set [d\ = d. For a vector i = {ti, . . . ,tm) G B™', we write 
[i\ = ([tij, . . . , [tmj) G N™. For two vectors ti,t2 G IB™, we define the dot product ti • t2 as 

Lemma B.4 Let d G B™ such that d ^ N™ and it does not contain any zero entry. For every 
N € N™ such that N ■ 1 > {d ■ 1)^ + [d ■ 1), there exists a d-regular graph G of size N, where 
deg(G) <(J-1) + 1. 

Proof. The proof is a direct application of Lemma IB. 2[ Let d = {di, . . . , dm). There are two 
cases. 

• iV • d is an even number. 

Then by Lemma IB.2|, there exists a [dj -regular graph G of size N, which is also a 
d-regular graph. Obviously, deg(G) < (d • 1) -|- 1. 

• iV • t is an odd number. 



By Lemma IB. 21 there exists an almost [dj -regular graph G of size N. Let Vi U ■ • • U Vm 
and u be the culprit vertex in G. Let i be an index such that di G ^N. Let t; G T^j be a 
vertex not adjacent to u. Such a vertex v exists since iV • 1 > (d • 1)^ -|- (J- 1). Adding 
the edge (n, v) into G, we obtain a d-regular graph of size N and deg(G) < d • 1 -|- 1. 

This completes the proof of our lemma. I 

From Lemma IB. 41 we immediately get the following lemma. 

Theorem B.5 For every d G B'", there exists a Preshurger formula REGj(X), where X = 
{Xi, . . . ,Xm) such that the following holds. There exists a d-regular graph of size N if and 
only if REG^{N) holds. 

Proof. Apply Theorem IB. 3) if d G N'". Otherwise, we apply Lemma lB.41 and run through 
the same argument as in the proof of Theorem IB. 31 We omit the details of the proof. ■ 
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Proof of Theorem 14. IL We essentially run through the same argument in Subsection lB.3l 
with a slight adjustment in the constants. 

Given a matrix ^ = \ G N without zero column, we define the following set 
\ie ) 

Ijj ■= {iV I iV • 1 < 2£{D -l + lf + M and there exists a C-regular graph of size N] 

Then, we define the formula REGdC-^) inductively, where X = {Xi, . . . ,Xm) as follows. For 
simplicity, we assume that D does not contain zero column. (If column i in D is a zero column, 
we simply add Xi >0 and ignore the column.) 

• When £ = 1: 

REGd(X) := REGi,(X) 

• When £>2: 

REGd{X) := y X = N V 

NeiD 
V {x-x{ij)>2{D-l+£f + 3 A REGo_f,(^) A REGj^,(X) 

where x{dj) is the characteristic vector of djlj and D — dj denotes the matrix D without 
row j. 

We can show by induction on i that the following holds. 

• If there exists a D-regular graph of size N then REGd(-/V) holds. 

• If REG£)(iV) holds, then there exists a D-regular graph of size N with deg(G) < {D-l)+i. 

The details are similar to the one in the previous subsection, hence omitted. 



C Proof of Theorem 14.2 



In this section we present our proof of Theorem 14. 2[ We start with the following lemma which 
essentially states that if there exists a D-regular-complete graph of "big enough" size, then 
the matrix D itself has certain property. 

Lemma C.l Let G = {V^Ei, . . . ,Efi) he an (.-type D -regular graph, where D G B ^"^ and 
F = Fi U • • • U Vm is the partition of the regularity. Suppose that for each i, we have 

\Vi\ > {D-l) + l. 

If G is also a complete graph, then for every i,j G {1, . . . ,m}, there exists I G {1, ■■■,£} such 
that both Di^i,Dij G *"N. 



^^The characteristic vector of c = (ci, . . . , Cm.) £ B"* is defined as x(ci, ■ • • , Cm) ■— (foi, . . . , 6m) £ {0, 1}" 
where 6i = if Ci = 0, and bi = 1 ii Ci ^ 0. 
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Proof. Let G = {V,Ei,... ,Ei) be a L'-regular-complete graph where D G B^^™ and V = 
^1 U • • • Vm the partition of the D-regularity Suppose that ti, . . . , tg are the row vectors of D 
and|Vi|,...,|V;„| >D-1 + 1. 

For the sake of contradiction, we assume that that there exist i,j G {!,••• jfn} such that 
for all I € {1, ... ,i}, either Dii G N or Dij G N. We assume that i ^ j. The case when i = j 
can be settled in a similar manner. We are going to count the number edges crossing between 
Vi and Vj and show that such number is strictly less than \Vi\ ■ \Vj\, which contradicts the fact 
that G is a complete graph. 

For each / G {1, . . . ,i}, we define the integer Ki as follows. 

^ r m-Di,, if A,iGN 

If both Dii and Dij belong to N, then we choose \Vi\ ■ ti^i for Ki. Then, we have 

l<l<k leL l^L 

where L = {I \ Dii € N}. Now for each / G {1, . . . , /c}, we define Ai as the set of E'z-edges 
crossing between Vi and Vj. Since G is a complete graph, we have 

1</<A: 

Moreover, G is D-regular, hence we have \Ai\ < Ki for each I G {1, . . . , k}. Thus, 

E i^'i ^ E K^ 

l<l<k l<l<k 

\Vi\-\Vj\ < |V•|•EA,^ + |F,-|-EAj, 
However, such inequality cannot hold due to the fact that 

and 

|^i|,|"l^j| > I?- 1 + 1. 

This completes the proof of our lemma. I 

This lemma then motivates us to introduce the following notion of easy matrix. We way 
that a matrix Z) G B ^"^ is an easy matrix, if for alH, j G {1, . . . , m}, there exists / G {1, . . . , -^j 
such that both Di^i,Dij G ^N. The following theorem shows the reason why it is called an 
easy matrix. 

Lemma C.2 Let D £ M ^"^ be an easy matrix. Then the following holds. There exists a 
D -regular- complete graph of size N if and only if REG£){N) holds. 
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Proof. Let D G B ^"^ be an easy matrix. The "only if" direction follows directly from 
Theorem 14.11 We prove the "if" direction. Suppose REGd(-^) holds. By Theorem 14.11 there 
exists a D-regular graph G = {V,Ei, . . . ,E£) of size N. This graph G is not necessarily 
complete. So suppose V = Vi U • • • U Vm be the partition of the regularity. If G is not 
complete, then we perform the following. For all u,v (^V such that {u,v) ^ EiL) ■ ■ ■ L) Eg, do 
the following. 

• Let u (^Vi and v £ Vj. 

• Pick an index / G {1, . . . ,k} such that Dii,Dij G ^'N. 
(Such an index I exists since D is an easy matrix.) 

• Connect u and v with an £';-edge. 

The resulting graph is now complete and still D-regular. This completes the proof of our 
theorem. ■ 

The proof of Theorem 14.21 is essentially obtained by combining Lemmas IC.ll and IC.2[ The 
main idea behind the formula REG-CO MP£)(X) is as follows. Suppose D is not an easy matrix. 
Let J be the set of columns in D such that without those columns in J the matrix D is an 
easy matrix. Lemma IC.ll tells us that if there exists a Z)-regular-complete graph of size N, 
then the entries in N corresponding to the set J must be bounded from above. These entries 
then can be encoded as a Presburger formula via the notion of partial graph below. 

A partial graph is a pair (P, /, n) , where 

• P is an i-type graph; 

• / is a function V{P) x {Ei, . . . ,Et>} x {1, . . . ,n} ^M. 

A completion of the partial graph (P, /, n) is an ^-type graph G = {V, Ei, . . . , E() such that 

• P is a subgraph of G, i.e., V{P) C V{G) and Ei{P) C Ei{G) for each i = 1, . . . ,^; 

• there is a partition of the vertices V{G)\V{P) = ViU- • -UFn, where for each i = 1, . . . ,i, 
for each j = 1, . . . , n, for each vertex v G V{P) the number of vertices in Vj adjacent to 
V by E'j-edges is f{v,EiJ). 

The gist of the proof of Theorem 14.21 is as follows. Given a partial graph (P, /, n) and an 
easy matrix D G B ^'^, we are going to construct a formula '^[pj^n),D such that there is a 
completion G of the partial graph (P, /, n) with an additional condition that the partition 
V{G) \ V{P) = Vi U ■ ■ ■ U Vn, satisfies the following. For each i = 1, . . . , ^, for each j = 1, . . . , n, 
for each vertex v £ Vj, deg^;. (u) = Dij. The construction of the formula ^(pj^n),D can be 
done by induction on the number of vertices in P. 

We present the details in the following paragraph. We need to define the operation addition 
+ on B as follows. 



di + d2 


= di + d2 


*^di + d2 


= ^di + da 


di + *'d2 


= *'{di + d2 


•^di + "-da 


= *'{di + d2 



Obviously, we can extend + to the spaces B™ and B ^™, where they are performed component- 
wise. We also need to define the subtraction on ^N as follows. For di,d2 G N, 

*-(l ) -d = i "^^^ ~ ^^'* ^^ '^^ - '^^ 
^ otherwise 
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For a matrix D E IB ^"^ and a set I Q {1, . . . , m\, we write Di the matrix in IB ^ ' ' obtained 
from D by deleting the columns not in /. For two matrices D G ig^x'^i and D' € B^^^^, we 
write {D\D') to denote the matrix in IB x(™-i+"^2)^ where the first mi columns are D, while the 
last ?7i2 columns are D' . 

For a function f : U x {Ei, . . . , E'^} x {1, . . . , n} — )■ B, an ^-expansion of the function / is 
a function 

g : Ux{Ei,...,Ee}x{{l,...,7i}x{l,...J+l}) ^ B 

such that for each u G U , I G {1, . . . , i + 1} , i G {I, . . . ,n}, 

^ g{u,Ei,{i,j)) = f{u,Ei,i). 

Abusing the notation, we can view the domain of g as U x {Ei, . . . , E^} x {1, . . . , n{i + 1)}, 
instead of U x {Ei, . . . , Eg] x ({1, . . . , n} x {1, . . . , ^ + 1}). Also we write the function / \ {u} 
obtained from the same function / but restricted to ^ \ {u}. 

For a matrix D € B^^"", we define an operator i{D) € B^^(^"'+"') as follows. Let D = {c\ \ 
■ • • I c^J, that is, c^, . . . , cf„ are the column vectors of D. 



$,{D) := (Z?i I c{ I Z)2 I 4 



) I cM 



where Di = {c\\ ■ ■ ■ \ c\) — Ig G B and /^ is the identity {I x i) matrix. We remark that if 
D is an easy matrix, then so is S,{D). 

Lemma C.3 Let {P,f,m) be a partial graph. For every matrix D € B ^™, there exists a 
Presburger formula ^(pj^m\j;){X), where X = (Xi, . . . ,Xm) such that the following holds. 
The sentence ^tpf„^\£){N) holds if and only if there exists a graph G = {V,Ei, . . . jE^) in 
which there is a partition V = Vq U V^i U • • • U Vm such that 

. Vo = V{P); 

. Ei{P)CEiforeveryle{l,...,i}; 

• (|Fl|,...,|K^|) = iV; 

• for each u S V{P), for each I € {1,...,^}, for each j € {l,...,m,}, the number of 
El -edges from u to Vj is f{u,Ei,j); 

• for each j G {1, . . . , m}, for each v G Vj, for each /€{!,...,£}, the degree deg^^ (v) in 
G is Dij . 

Proof. Let (P, /, m) be a partial graph, and let ai, . . . , q^ be the enumeration of the vertices 
in P. 

For an integer /i G {0, 1, . . . , s}, a function g : {ai, . . . , ah} x {Ei, . . . , Eg} x {1, . . . , n} and 
an easy matrix C G B ^", we define the formula ^h,g,c inductively on h as follows. 

'&o,0,n,c(^) := REGc(X) 

^h+l,g,n,c{X) := BZi^i • • • 3Zi^£+i 3^2,1 • • • 3Z2,e+i 3Zn,i ■ ■ ■ 3Zn,e+i 

/\ Zi^i + • • • + Zi^i^i = Xi 

l<i<n 

A /\ Zij = g{ah+i,Ej,i) 

j s.t. g(ah+i,Ej,i)eN 
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A /\ Zij> g{ah+i,Ej,i) 

j s.t. g{ah+i,Ej,i)e*-n 
g' is an ^-extension of g 

We note that when h = 0, then the function g is the empty function. Now the desired formula 
^{Pj,m),D is defined as follows. 

'^{P,f,m),DiX) := ^sJ,m,DiX). 

That the formula ^fpj„^-\£){X) is the desired formula comes from the following claim. For 
h G {0, 1, . . . ,s}, we are going to write Ph as the subgraph of P restricted to the vertices 
ai, . . . , Q/i. By default, we set Pq to be the empty graph. 

Claim 1 For an integer h G {0, 1, ... , s}, a function g : {ai, . . . , ah} x {£^1, . . . , Eg} x 
{l,...,n} and a matrix C € B ^", the following holds. The sentence ^h,g,c{^) holds if 
and only if there exists a graph G = {V,Ei, . . . ,Ei) in which there is a partition V = 
VoUViU---UVm, such that 

. Vo = V{Ph); 

. Ei{Ph) <Z El for every I e {!,...,£}, ■ 

• (|Vi|,...,|y^|) = iV; 

• for each a € V{Ph), for each I € {!,...,£}, for each j E {!,■■■ , w,}, the number of 
El -edges from a to Vj is g{a,Ei,j); 

• for each j G {!,..., m}, for each v G Vj, for each I € {!,...,£}, the degree deg^^ (v) in 
G is Dij . 

We are going to prove the claim by induction on the integer h. The base case /i = holds 
due to Lemma I C 2 [ For the induction hypothesis, we assume that the claim holds for case h. 

We are going to prove the claim for case h + \ for the induction step. First we prove the 
"if" direction. Suppose there exists a graph G = {V, Ei, . . . , En) in which there is a partition 

Vb U Vi U • • • U Ki of y, such that 

. Fo = V{Ph+i); 

• Ei{Ph+i) C El for every /€{!,...,£}; 

. (|yi|,...,|K|) = ^; 

• for each a € V{Ph+i), for each / G {!,...,£}, for each j G {!,..., n}, the number of 
Ei-Qdges from a to Vj is g{a,Ei,j); 

• for each j G {1, . . . , n}, for each v G Vj, for each I G {1, . . . ,£}, the degree deg^;^ (v) in G 
is Gij] 

Now for each j G {1, . . . , n}, we further partition Vj into Vj^i U • • • U Vj^g U Vj/+i, where Vj^i is 
the set of vertices in Vj connected to a/i+i by ii^^-edges for / = 1, . . . ,£ and V^-,^+i is the set of 
vertices in Vj that is not connected to ah+i- It is straightforward application of the induction 
hypothesis that the sentence ^h+i,g,c{^) holds. 

The proof for the "only if" direction is very similar. For completeness, we prove it here. 
Suppose <^h+i,g,c{N) holds. Let Mi,i, . . . , Mi,£+i, M2,i, . . . , M2,i+i, . . . , Mn,i, ..., Mn,e+i be 
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the witnesses to the variables ^1,1, . . . , Zi^^+i, ^2,1, . . . , ^2,^+1, . . . , Zn^i, ■ ■ ■ , Zn/+i such that 
the sentence ^h+i,g,c{^) holds. By the definition of ^h+i,g,c(-^)) there exists a function g' 
which is a ^-extension of g such that 

^h,g'\{a,+,UiC)iiMl,l, . . . ,Mi,,), . . . , {Mn,U . . . ,M„,,)) holds. 

By the induction hypothesis, there exists a graph G = {V,Ei,...,E£) in which there is a 
partition Vq U Vi^i U • • • U Vn/+i of V, such that 

. Vo = V{Ph); 

• Ei{Ph) C El for every / G {1, . . . , ^}; 

• ((|^i,i|, • • • , |V^i,ml), • • • , (|K,i|, . . . , IK/+1I)) = ((Mi,i, . . . , Mi,^+i), . . . , (M„,i, . . . , M„,f+i)); 

• for each a e y(P/i), for each / e {1, . . . ,£}, for each (j, j') S {1, . . . , n} x {1, . . . ,^}, the 
number of ii^/-edges from a to Vj^i is ^'(a, Ei, {j,j')); 

• for each (j, j') € {1, . . . ,n} x {!,...,£}, for each v e ^j'; for each I € {!,...,£}, the 
degree deg£;j(f) in G is Cijj'. 

Now for each i £ {1, . . . , n}, we define Fj = V^^i U • • • U V^^^+i, and the set of £'/-edges -E[ as Ei 
plus connecting the vertices in Vi^i to the vertex ah+i with £"; edges. By the constraint 

/\ ^i,l + • • • + Zi^i+i = Xi 
l<i<n 

A /\ Zjj =5r(a,,+i,Sj,z) 

J s.t. g{ah+i,Ej,i)<=N 

A /\ Zij >5f(Q/j+i,Ej,i) 

i s.t. g{ah+i,Ej,i)e*-N 

we get that the number of £^;-edges from a/^+i to Vi is g{ah^i,Ei,i). Hence, this way a 
partition Vq' U Vi U • • • U Vm of y, such that 

. V^ = V{Ph+i); 

. (|yi|,...,|y^|) = 7V; 

• for each a € V{Ph), for each / G {1, . . . ,i}, for each j G {1, . . . ,m}, the number of 
£^;-edges from a to Vj is g{a,Ei,j); 

• for each j G {1, . . . , m}, for each v G Vj, for each Z G {!,...,£}, the degree deg^^ {v) in 
G is Aj. 

This completes the proof of our claim, and hence, our lemma. I 

Note that in Lemma IC.3I above the completion graph G is not necessarily complete. To 
get a complete graph G, we have to insist that P itself is a complete graph and the matrix D 
is easy as stated below. 

Lemma C.4 Let (P, /, m) be a partial graph and P itself is a complete graph. For every easy 
matrix D £M '^™', there exists a Preshurger formula '^/pf^m\£){X), where X = {Xi, . . . ,Xm) 
such that the following holds. The sentence ^(p j,m.),D(-^) holds if and only if there exists a 
complete graph G = {V, Ei, . . . , Eg) in which there is a partition y = Vq U Vi U • • • U Vm such 
that 
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. Fo = V{P); 

• Ei{P) Q El for every I £ {1, . . . ,£}; 

• {\Vi\,...,\Vm\) = N; 

• for each u € V{P), for each I € {!,...,£}, for each j € {1, . . . ,m}, the number of 
El-edges from u to Vj is f{u,Ei,j); 

• for each j G {1, . . . , m}, for each v £ Vj, for each I € {!,...,£}, the degree deg^^{v) in 
G is Dij. 

Proof. The proof is very similar as above. We simply add the constraint Zi^i^i = for each 
i = 1, . . . ,n in the definition of the formula ^h+i,g,n,c{-^) above. ■ 

Proof of Theorem 14.21 The proof is a direct application of Lemma fC. 31 Let D G B^^"^, 

not necessarily easy matrix. For a subset J C {1, . . . ,m}, we write Dj as the matrix D with 
the columns only from J. 

A partial graph (P, f, n) is compatible with {D,J), if 

• \J\ = n; 

• there is a partition V{P) = l^^ U • • • U V,„,_„, where {ji, . . . ,jm-n} = {1, . . . , m} - J 
and \Vj.\ < D -1 for each ji ; 

• for each 1 < i < m — n, for each v £Vj., for each Ei, we have X^i<fc<^ f{v, Ei, k) = Dij.. 
Now the formula REG-COMP£)(X) can be defined as follows. 

V V 

J={ji,---,jm} s.t. Dj is easy (P,f,m) s.t. it is compatible witli {D,J) and we index the partition V{P)=[J^^j Vi 

^P,/,m,D, {Xj, , . . . , Xj„ ) A [\Xi=W\ 
The correctness of the formula follows immediately from Lemma IC.4I 



D Proof of Theorem 15.1 



For convenience, we restate Theorem 15.11 here. 

Theorem dill Let C G B^""™ and D G B^^". There is a Presburger formula BiREGc,D{X, Y), 
where X = {Xi, . . . , X^) and Y = (Yi, . . . , Yn) such that the following holds. There exists an 
i-type {C,D)-biregular graph of size {M,N) if and only if BiREGc,D{M,N) holds. 

The structure of the proof is the same as in Appendix |Bj The essence of the theorem lies 
on the case when C,D £ pj^^™. This is what we will consider first for the sake of presentation. 
The proof is divided into three successive steps. 

(1) First, we consider the simplest case when C, D G N^^^ in Subsection lD.il 

(2) Then we generahse it to the case C G N^^"" and D G N^^" in Subsection ID. 21 

(3) Finally we consider the case C G N^^™ and D G N^^" in Subsection ID. 31 

When C, D contain an element of B, it will be easier since there is more freedom in adding 
more edges. However, the proof will be more tedious. For this reason, we postpone the case 
when D contains an element of B until Subsection ID. 41 
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D.l When C,D EN 



1x1 



In this subsection we deal with the simplest case of (C, Z^)-biregular graph: the case when C 
and D consist of only one entry c and d, respectively. For convenience, we will simply write 
(c, d)-biregular graphs, instead of a more cumbersome notation ((c), (d) )-biregular graph. 

In this subsection and the next, we are dealing only with 1-type graph. Hence, we are 
going to write deg(w) to denote the degree of the vertex u, instead of deg£;(n). 

We start with the following proposition, which again appears to be a folklore in the graph 
theory. We represent the proof here since we are going to need it. 

Proposition D.l Let c,d > 0. For every M,N £ N, the following holds. There exists a 
(c, d)-biregular graph of size {M, N) if and only if N > c, M > d and M ■ c = N ■ d. 



Proof. Let c,d>0, and let M, A^ € N. The "only if" directions is straightforward. 

We first prove the "if" direction. Let M > d, N > c. Let K = Mc = Nd. First, we 
construct the following graph. 



M vertices 
Each of degree c 




UM 



,VK-c+1 



,VK 



> K vertices 
Each of degree 1 



On the left side, we have M vertices, and each has degree c. On the right side, we have 
K = Nd vertices, and each has degree 1. We are going to merge every d vertices on the 
right side into one vertex of degree d. The merging is as follows. We merge every d vertices 
Vi,Vi^]\f, ■ ■ ■ , f^i+(d-i)Ar into one vertex for every i = 1, . . . ,N. Since K = Nd, it is possible to 
do such merging. Moreover, N > c, hence we do not have multiple edges between two vertices. 
Thus, we obtain the desired (c, (i)-biregular graph of size (M, N). This completes the proof of 
Proposition ID. II ■ 



D.2 When C G N^^™ and D G N^^" 

In this subsection we consider the case when C and D consist of only one vector each. In this 
case, we are going to write (c, (i)-biregular graph, where c and d are the only vectors of C and 
D, respectively. 

Lemma D.2 Let c € N™ and d € N" and both do not contain zero entry. For each M S N™ 
and N eW such that 

M-l + N-l > 2(c-l)(J-l) + 3, 

the following holds. There exists a (c, d)-biregular graph of size (M, N) if and only if M ■ c = 
N -d. 
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Proof. Let c e N™ and d G N", both do not contain zero entry. Let M G N™, iV G N" such 
that 

M-l + iV-1 > 2(c-l)(J-l) + 3. 

The "only if" direction is straightforward. If G is a (c, (i)-biregular graph of size {M,N), then 
the number of edges in G is precisely M ■ c = N ■ d. 

Now we prove the "if" part. Suppose M G N™, iV G N" such that M ■ c = N ■ d. Let 
c= (ci,...,c^) and(i= (di, . . . ,d„),_and M = {Mi,...,M.m) and N_= {Ni,...,Nn). 

We are going to construct a (c, d)-biregular graph of size {M,N). We first construct a 
bipartite graph, in which 

• the left side has M ■ I vertices, where there are Mi vertices ui,i, . . . , ui,Mi and each has 
ci vertices adjacent to it; there are M2 vertices ti2,i, . . . ,U2,M2i and each has C2 vertices 
adjacent to it; etc; 

• the right side has M ■ c number of vertices, each of degree one. 
See the illustration below. 



Ml number of vertices 
of degree ci 



Mi.i 



> Cl 



Ul,Mi 




> Cl 



/- Wm.l 



Mm number of vertices 
of degree Cm 




> c„ 



'U-m,M, 




> C„ 



> M ■ c — N ■ d number of vertices 
Each of degree 1 



Obviously on the left side there are Mi vertices of degree ci, M2 nodes of degree C2, etc. 
However, on the right side there are M ■ c vertices and each is of degree one. We are going 
to do some merging of the vertices on the right side so that there are exactly A^i vertices of 
degree di, N2 vertices of degree d2, etc. We do the following. 

We "group" the vertices on the right side into Vi, . . . ,Vn where Vi has Nidi vertices, V2 
has N2d2 vertices, etc. Such grouping is possible because M ■ c = N ■ d. 

For each i G {!,..., n}, we do the following. We merge di vertices in Vi into one 
vertex, so that each vertex in Vi has degree di. The merging is done like in the proof 
of Proposition ID. II Let Vi = {vi^i, . . . ,Vi^Ki} where Ki = Nidi. We merge the vertices 



33 



vi,VN,+i,V2N,+i-, ■■■, W(d,-i)7v,+i into one vertex; the vertices V2,vn,+2,V2N,+2, ■■■, V(^d,-i)Ni+2 
into one vertex; and so on. 

After such merging, each vertex in Vi has degree d,. However, it is possible that after we 
do the merging, we have "parallel" edges, i.e. more than one edges between two vertices. (See 
the left side of the illustration below.) We are going to "remove" such parallel edges one by 
one until there is no more parallel edges. The trick is similar as the one in Subsection IB. 31 

Suppose we have parallel edges between the vertices u and v. We pick an edge {u' , v') such 
that u' is not adjacent to v and v' is not adjacent to u. (See the left side of the illustration 
below.) 



eE 



£E 




eE 



£E 




Such an edge {u\v') exists since the number of vertices reachable in distance 2 from the 
vertices u and v is < 2{c-l){d-l)+2 and the number of vertices is M -l + N -1 > 2(c-l)(d-l) + 3. 

Now we delete the edges {u',v') and one of the parallel edge {u,v), replace it with the 
edges {u,v') and {u',v), as illustrated on the right side of the illustration above. We perform 
such operation until there is no more parallel edges. This completes the proof. ■ 

The following theorem is a straightforward application of Lemma ID.2[ 

Theorem D.3 For every c € N™ andd G N", there exists a Preshurger formula BiREGr^^JX ,Y), 
where X = {Xi, . . . ,Xm) and Y = (Yi, . . . ,Yn) such that the following holds. There exists a 
{c,d)-biregular graph of size {M,N) if and only if the sentence BiREG/^ ^\{M , N) holds. 



Proof. The proof is a direct application of Lemma ID. 21 It can be proved with the same line 
of reasoning as Theorem IB. 31 We omit the details. I 



D.3 When C E N^^™ and D G N^^" 

In this subsection we are going to generalise Theorem ID. 31 to the case i > 1. 

Theorem D.4 For every C € N and D G N , there exists a Preshurger formula 

BiREGcniX ,Y), where X = {Xi, . . . ,Xm) and Y = (Yi, . . . ,Yn) such that the following 
holds. There exists a {C,D)-biregular £-type graph of size {M,N) if and only if the sentence 
BiREGc,D{M,N) holds. 

Proof. The strategy of the proof here is also very similar to the one in Theorem 14. 11 In fact, 
we repeat the same line of reasoning with minor adjustment to the bipartite graphs setting. 
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c-1 \ 
Given C = \ '■ \ £ N^><'" and ^ = I : I G N^^*^ without zero column. We define 

the fohowing set 

J .= / (Af iV) M-l + N-l<2i{C-l){D-l) + 3iand 1 

|_ there exists a (C, D)-biregular graph of size {M, N) J 

Then, we define the formula B'\REGc\DiX ,Y) inductively, where X = {Xi, . . . ,Xm) and 
Y = (Yi, . . . ,Yn) as follows. For simplicity, we assume that C and D do not contain zero 
column. (If column i in matrix C (or, D, respectively) is zero column, then we add the 
constraint Xi >0 (or, Yi > 0, respectively) and ignore that column.) 



When i=l: 



When £>2: 



B\REGc,d{^,Y) := BiREG,^,-^(X,y) 



BiREGc,D(^,^) := V X = M A Y = N 

{M,N)Glc,D 

V V ^X-x{cj) + Y-x{dj)>2{C-l)iD-l) + 3 

A REG^_,^.,^_,-^,(X,y) A REG,-^,j^,(X,F)) 

where x(cj),x('^j) ^re the characteristic vectors of Cj and (ij defined in Subsection IB. 31 
and C—Cj, D—dj denote the matrices C without row j and D without row j, respectively. 

The correctness of our formula can be proved in a similar manner as Theorem 14.11 hence we 
omit the details. This completes our proof. ■ 



D.4 When C and D contain elements from B 

In this subsection we are going prove Theorem ID. 41 when C, D contain elements from B. 
As warm up, we consider the following easy case, from which Theorem 15.21 can be easily 
generalised. 

Proposition D.5 Let c, (i > 0. For every M, A^ E N, the following holds. 

(a) There exists a {c,^d)-biregular graph of size {M,N) if and only if M > d, N > c and 
Mc > Nd. 

(b) There exists a (^c, *'d)-hiregular graph of size (M, N) if and only if M > d, N > c. 

Proof. Let c, d > 0, and let M, A^ € N. The "only if" directions on all parts (a) and (b) are 
straightforward. 

The "if" direction of part (a) can be proved in a similar manner as Proposition lD.il First, 
we construct a (c, l)-bipartite graph of size (M, Mc). Since Mc > Nd, when we do the merging 
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among the vertices on the right side, we merge at least d vertices Vi,Vi+N, ■ ■ ■ ,t'i+(d-i)Ar into 
one vertex for every i = 1, . . . ,N. Hence, after the merging each vertex has degree > d. 

The "if" direction of part (b) is straightforward. If Mc > Nd, then we construct a (c, *'d)- 
biregular graph of size {M,N). If Mc < Nd, then we construct a (^c, (i)-biregular graph of 
size {M,N). This completes the proof of Proposition ID. 51 ■ 

Proposition ID. 51 can be generalised to the case when C and D consist of one row, as stated 
in the following theorem. 

Theorem D.6 For every c € B™, d £ B", there exists a Presburger formula BiREG,^^JX,Y) 
such that the following holds. There exists a {c, d) -biregular graph of size {M,N) if and only 
if the statement BiREG/^ ^\{M , N) holds. 

We postpone the proof of Theorem ID. 61 until later. It basically follows directly from the 
following lemma. 

Lemma D.7 Let c € N™ and d € N" and t e (^'N)^'. For all M G N™ and iV e N" and 
K £ n^ such that M -1 + N -1 + K -1 > 2{c ■ l){d ■ I + i ■ 1) + 3 and K ■ 1 > c-1, the 
following holds. There exists a (c, {d,t)) -biregular graph G of size (M, {N,K)) if and only if 
M -cyN -d + K -i. 

Proof. The proof is almost the same as Proposition lD.il Let c = (ci, . . . , Cm), d = (di, . . . , dn) 
and * = (*-*!,..., *'tk). Let M € N™ and iV G N" and K € N'= such that 

M-l + iV-1 + ^-1 > 2(c-l)(J- l + t-l) + 3, 
K -1 > c-1 

The "only if" part is straightforward. If there exists a (c, ((i,t)) -biregular graph of size 
(M, (N, K)), then the number of edges in the graph is M -c, which should be > {N ■ d) + {K ■ t) 

For the "if" direction, let M = (Mi, . . . , M„,), N = {Ni,..., iV„), K = {Ki, . . . ,Kk) such 
that M ■ c > {N ■ d) + (K ■ t). We are going to construct a (c, ((i,t)) -biregular graph of size 
{M,{N,K)). First, we construct the following graph, as illustrated below. On the left side 
there are M ■ c vertices, each of degree 1. On the right side there are A^i vertices of degree 
di, N2 vertices of degree d2, and so on; and Ki vertices of degree ti, K2 vertices of degree t2, 
and so on; and M ■ c— {N ■ d + K -t) vertices of degree 1. We call the edges adjacent to those 
M ■ c— {N ■ d + K ■ t) vertices the auxiliary edges, and the vertices the auxiliary vertices. 



36 



M ■ c vertices ^ 
Each of degree 1 



di vertices < '. 




d\ vertices 



dn vertices 



dn vertices 



il vertices' 



t\ vertices 



ti. vertices < '. 



tk vertices' 



"1,1 




«l,JVi 




wi,i 




""l.Ki 



Wk.l 




'"fe.-fffc 



> A'^i vertices of degree di 



• Nn vertices of degree d-, 



■ Ki vertices of degree ti 



> -ft'fe vertices of degree ij. 



M ■ c — (N ■ d + K ■ t) vertices of degree 1 
Those edges are called auxihary edges 



Then we partition the vertices on the left into Vi U • • • U Vm as follows. The first group Vi 
consists of Mici vertices, the second group V2 consists of M2C2 vertices, and so on. Then we 
merge every ci vertices in Vi into one vertex, every C2 vertices in V2 into one vertex, and so 
on. The merging is done like in the proof of Lemma ID. 21 After such merging, on the left side 
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there are Mi vertices of degree ci, M2 vertices of degree C2 and so on. 

However, with such merging, we can have parahel edges between two vertices. If so, we 
apply the standard trick used in Lemma ID.2I Suppose we have parahel edges between the 
vertices v and u. We pick a vertex u' of non zero degree with distance > 2 from either both u or 
V. Such a vertex exists since the number of vertices is M-I+iV-I+^-1 > 2(c-I)(d-I+t-l)+3, 
and the number of vertices of distance 2 from both u and f is < 2(c ■ l){d ■ 1 + i ■ 1) + 2. 

Pick an edge {u',v') for some neighbour v' of u'. We replace the edges {v,u) and {v',u') 
with {v,u') and {v',u). We do this until there is no more parallel edges. 

Hence we get a bipartite graph G = {U,V UW U Wq, E) such that 

• there is a partition [/ = C/i U • • • U Um, V = ViU ■ ■ ■ UVn and W = WiU ■ ■ ■ U Wk] 

• for every i G {1, . . . , m}, for every vertex u G Ui, deg(n) = q; 

• for every z G {1, . . . , n}, for every vertex f G Vi, deg(f ) = (i,; 

• for every i G {1, . . . , k}, for every vertex w G Wi, deg(ti) = ij; 

• for every vertex w G Wq, deg(ty) = 1. 

(The vertices in Wq are the auxiliary vertices.) 

Now we want to eliminate the auxiliary edges. Let (n, w') be an auxiliary edge, where 
u £ U and w' G Wq. Then we pick a vertex w £ W such that {u,w) ^ E. Such a vertex w 
exists since, K -l > c-1 > deg{u). Then delete (n, w;') and add in the edge {v, w). We do this 
until there is no more auxiliary edges. 

After such elimination of the auxiliary edges, we have a bipartite graph that 

• on the left side there are Mj vertices of degree Cj, for each i = 1, . . . ,m; 

• on the right side among the vertices u's there are Ni vertices of degree di, for each 
i = l,...,n; 

• on the right side among the vertices w^s there are Ki vertices of degree > tj, for each 
i = 1, . . . ,k. 

This is a (c, (d, t))-biregular graph of size (M, {N, K)). This completes our proof of Lemma fD . 71 



Lemma D.8 Let c G N"", s G (''N)'' and d eW, t e (*'N)^ For every M G N™, K G N*^, 
N eW and L e N' such that 

M -l + K -l + N -l + L-l > 2(c-I + s-I)(J-I + t-I) + 3, 

the following holds. 

(a) If M-c+K-s > N-d+L-t and L-1 > c-l+s-1, then there exists a {{c, [s\), {d,t))-biregular 
graph of size {{M,K),{N,L)). 

(h) If M ■ c + K ■ s = N ■ d + L -i, then there exists a ((c, [sj), {d, \t\))-hiregular graphof size 

{{M,K),{N,L)). 

(c) If M-c+K-s < N-d+L-i and K-1 > d-l+i-1, then there exists a ((c, s), {d, [i\))-biregular 
graphof size ((M, K), {N, L)). 
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Proof. Parts (a) and (c) follow from Lemma ID. 71 while part (b) from Lemma lD.21 



Proof of Theorem ID.6L Without loss of generality, we are going to construct a formula 
BiREG(g J) (Jq(X, Y), where c G N™, s G (''N)'= and d G N", i G C^N)' and X = {Xi, . . . , X^+k) 
and Y = (Yi, . . . , !"„+;). It should be noted that it is possible that any of m, k, n, I is zero. 

We will also denote X = (Xi, X2), where Xi = {Xi, . . . , Xm) is the vector of the first m 
variables from X, while X2 = {Xm+i, ■ ■ ■ ,Xm+k) the vector of the last k variables from X. 
Similarly, we also denote Y = {Yi,Y2), where Yi = (Yi, . . . , Yn) is the vector of the first m 
variables from Y, while Y2 = (^,+1, • • • , Yn+i) the vector of the last k variables from Y. 

Without loss of generality, we may make the following assumptions. 

• Both c and d do not contain zero entry. 

If say Cm = 0, then we can add the inequality Xm > and ignore that entry. Formally, 
we can define BiREG^g jn Mf)(X,y) as follows. 

Xm>0 A B\REG(^^^^^^^^^^__^^g^^(^j^^{Xi,... ,Xm-l,Xm+l,--- ,Xm+k,y) 

We can do similar trick if d contains zero entry. 

• Both s and i do not contain ^ entry. 

If say Sk = ^0, then we define B\REG/^g\/^p.{X, Y) as follows. 

3Zi 3Z2 Zi>0 A Zi + Z2= Xm+k 

A BiREG(g,.g^^^^^_^^^_^^^)^(j^j)(Xi,. . . ,Xm+k-i,Z2,Y) 

Intuitively, the set of vertices with degree at least zero can be divided into two: one set 
of Zi vertices with degree zero and the other of Z2 vertices with degree at least one. We 
can do similar trick if i contains *X) entry. 

Lemmas ID. 71 and ID. 81 immediately gives us a Presburger formula that characterises the 
existence of ((c, s), (d, i))-biregular graph of size ((M, K), (iV, L)) when 

M-l + K-l + iV-l + Z-1 > 2(c-l + s-l)((i-l + t- l) + 3 

K-l > d-l + i-1 
L-l > c- 1 + s- 1 

What is left is to handle one of the following cases. 

(a) M-l + K-l + iV-l + Z-1 <2(c-l + s-l)((i-l + t- l) + 3. 

(b) Either K-l<d-l + i-lorL-l<c-l + s-l. 

Case (a) is trivial. We enumerate all those vectors {{M,K), {N,L)) such that there exists a 
(c, s), ((i, t)-biregular graph of size {{M , K) , {N , L)) inside the formula B\REG/^^\jjn{X,Y). 

For case (b), we define the notion of partial graph for bipartite graph similar to the one 
defined in the proof of Theorem 14.21 

For completeness, we define it below. A partial graph for bipartite graph is a tuple 
{P,f,g,rn,n), where 

• P = {U,V^E) is a. bipartite graph; 
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• / is a function U x {1, . . . , n} ^^ B; 

• (7 is a function V x {1, . . . , m} — ?• B. 

A completion of the partial graph (P, /, 5, m, n) is a bipartite graph G = ([/', F', £■') such that 

• P is a subgraph of G, i.e., [/ C [/', y C y' and E^ C £)'; 

• there is a partition of the vertices V \V = Vi U • • • U T^n where for each j = 1, . . . , n, 
for each vertex u ^U the number of vertices in Vj adjacent to u is f{u,j); 

• there is a partition of the vertices U' \U = UiL) ■ ■ ■ L) Um, where for each j = 1, . . . ,m, 
for each vertex v (zV the number of vertices in Uj adjacent to v is g{v,j). 

Using this notion of partial graph, in a manner similar to the proof of Theorem l4.2l we can 
similarly encode the part of (c, s), (d, t)-biregular graph with a fixed size into the Presburger 
formula BiREG/g j\(X, F). The details are omitted. 

Proof of Theorem 15. IL In the same manner as in the proof of Theorem ID. 41 Theorem ID. 61 
can be generalised to obtain Theorem 15.11 the details of which are omitted. 

E Proof of Theorem 15.2! 

The proof is very similar to the proof of Theorem 14. 2| so we just sketch it here. The following 
lemma is the bipartite counterpart of Lemma IC.ll The proof is also very similar to the proof 
of Lemma IC.li 

Lemma E.l Let G = {U,V,Ei, . . . ,E£) be an i-type (C,D)-biregular graph, where C = 

ci\ ( di \ 

... \ (z ]B^><™ ' ^ = 'L' M= ^^''" andU = UiU---UUrr, and V = Vi U ■ ■ ■ U Vn 

ce / \ ^W 

is the partition of the regularity. Suppose that for each i,j, we have 

\Ui\, \Vj\ > {Y^c,)-l + {Y,dj)-l + l. 

i j 

If G is a complete bipartite graph, then for every i E {!,..., 771} and j € {l,...,n}, there 
exists I € {1, . . . ,i} such that both Ci^i,Dij G ^N. 

Similarly as in the regular graph, we say that a pair of matrices (C, D) £M ^"^ x B ^" is an 
easy pair of matrices, if for every i G {1, . . . , m} and j G {1, . . . ,n} there exists / E {1, . . . , ^} 
such that both Ci^i,Dij E ^N. The following lemma can be proved in the same way as 
Lemma IC.2I 

Lemma E.2 Let (C, D) be an easy pair of matrices. Then the following holds. There exists 
a [G,D)-biregular- complete graph of size [M,N) if and only if BiREGc,D{M,N) holds. 

Now Theorem 15.21 can be easily proved in a similar manner as in Appendix [Cl with the 
difference that now we use partial graph for bipartite graph defined in Subsection ID. 41 
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F Proof of Theorems 17.11 and 17.21 

The proof is by observing that the existence of a (C, D)-directed-regular graph of size N is 
equivalent to the existence of a (C, -D)-biregular graph of size {N,N). We explain it more 
precisely below. 

• Suppose G = (y,Ei,..., En) is a (C, £))-directed-regular graph of size N . 

Then, for every vertex -y S y, we "split" it into two vertices u and w such that u is 
only adjacent to the incoming edges of v and w to the outgoing edges of v. See the 
illustration below. The left-hand side shows the vertex v before the splitting, and the 
right-hand side shows the vertices u and w after the splitting. 






Let U be the set of vertices u's and W the set of vertices w's after splitting all the 
vertices in V . Ignoring the orientation of the edges, the resulting graph is a bipartite 
graph with vertices U \JW and it is a (C, L')-biregular graph of size (iV, N). 

Suppose G = {U,W,Ei,. . . ,Ei) is a (C, D)-biregular graph of size {N,N). Let U = 
UiU- ■ -UUm and W = WiL)- ■ -U Wm be the partition of (C, Z?)-biregularity. We denote 
by Ui = {ui^i, ... , Ui^Ki) and Wi = {wi^i, ... , Wi^Xi} for each i = l,... ,m. 

Now we put the orientation on all the edges from U to W. Then we merge every two 
vertices Uij and Wij into one vertex Vij. This way, we obtain a (C, -D)-directed-regular 
graph G = {V, Ei, . . . , E^) with y = Vi U • • • U Vm be the partition of regularity where 
Vi = {vi,i, ■■■ , Vi^Ki] for each i = l,...,m. 

However, with such merging it is possible that there is a self-loop (v, v) in G or a pair 
of edges {v,v'), {v',v) G Ei U ■ ■ ■ U Ei. We can get rid of the self-loop {v,v) without 
violating the (C, D)-directed-regularity as follows. The trick is similar to the one used 
before. Assuming that the size of each |Vi|, . . . , \Vm\ is big enough and there are enough 
edges in each Ei,. . . ,Ei, there is an edge {v',v") of the same type. Deleting the edge 
{v,v) and {v',v"), and adding the edges {v',v) and {v,v"), we obtain a (C, Z))-directed- 
regular graph with one less self-loop. We do this repeatedly until there is no more 
self-loop. See the illustration below. 
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^Ei 




eEi 
-^ 




Similarly, we can get rid of a pair of edges (f , v'), {v' ,v) € EiU- ■ -UEi without violating 
the (C, I?)-directed-regularity as follows. Again, the trick is similar to the one used 
before. Assuming that the size of each |yi|, . . . , \Vm\ is big enough and there are enough 
edges in each Ei, . . . ,E£, there is an edge {w,w') of the same type. Deleting the edge 
{v, v') and (u), w')^ and adding the edges {y, w') and {w, v'), we obtain a (C, Z?)-directed- 
regular graph with one less parallel edges. We do this repeatedly until there is no more 
parallel edges. See the illustration below. 



w 



£ EiU---UEf 




€Ei 



€Ei 
-^ 



w 



e EiU---U Ei 




If some sets Vi or \Ei\ are of a fixed size, those can be encoded in a partial graph in the 
same manner discussed in Section ICl 

We omit the technical details since we essentially run through the same argument used in the 
previous sections. 



G The details for the proof of Proposition 16.11 

The formal proof is as follows. Recall that V = {Pi, P2, ■ ■ ■} be set of unary predicates used 
in (f). Abusing the notation, we let PREB,^ itself to denote the set {A^ | PREB^(A) holds}. We 
claim that PREB,^ = Spec(0). 



We first show the C direction. Let N e PREB,^. Let M = {Mt^j^, 



M 



T f 



be the 



witnesses to X such that PREB0(A) holds. In the following we are going to write Mt to 
denote {Mtj^,. ■ ■ , Mtj^) for every type T eT^. 

By definition N = X^z-p /•^ M(x f)- We take a set V oi N vertices and we partition V = 



Vt 



Y.(TJ)^{TJ)- 

U %„,/,„) such that \ViTj)\ 



M(rpj'^ for each T G T^ and / € /". We denote by 



^(T,/i) U • • • U V^T,/„) for each T G T^. 

Now since CON(M) holds, by Theorems 14. 2| for each T € T<^, there exists a L'-r-regular- 

complete graph Gt = {Vr, Rt,i, ■ ■ ■ ,Rt,£) of size Mt, with Vp = ^(r,/i) U ••• U V{T,fm) 

be the partition of Dy-regularity. Similarly, by Theorem 15.21 for each S,T (^ Tij), there 

exists a (i:'s^T,^T^s)-biregular-complete graph Gs,t = {Vs,Vt,Rs,t,i, ■ ■ ■ ,Rs,T,() of size 
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{Ms, Mt), with Vt = ^(T,/i) U • • • U V{Tjm) ^^'^ ^s = ^(5,/i) U • • • U V(s,/„) be the partition of 
{Ds^T, -DT^s)-biregularity. 

Let G be the overall graph G = {V, Ri, . . . ,Ri), where 

R^ = \jRT,i U \JRs,T,^ 

T S,T 

Then we label each vertex v (z V with a subset of S as follows. For each T E T,/,, for each 
f € Vt, we "declare" that v is labeled with a unary predicate P G 7^ if and only if P G T. 

We claim that G \= (p. For that it is sufficient to show that for each T G T^, for each 
V G Vt, typefj(u) = T. The proof is divided into three cases. 

• For each unary predicate P G P, it is by our labelling of the vertices of G that P{v) 
holds in G if and only if P G T. 

• For each 0/j /U G T, we have ^^t' st T'gu f{T,R,T') > I number of P-edges adjacent 
to V. Since every function / G J-" is consistent, 0/j /U G type(u). 

• Similary, for each O/j fJ- ^ T, and hence -■(O^ /i) G T, we have X^^., g ^ j./^ /(T, R, T') < 
I — 1, number of P-edges adjacent to v. Since every function / G J^ is consistent, 
^0^ /i G type(w). 

Therefore the graph G \= (p, and hence n G Spec(i;^). 

Now we prove the direction 5. Suppose 21 ^ (/< is of size N. Let M = {Mfj^^j^-^, . . . , M(7^^ j^ )) 
where Mixj) be the number of elements of type T in which there exists /(T, P, S) number of 
P-edges going to elements of type S. Take each Mtj-j) to be the witness for Xfrpj) for each 
T G T^ and / G F. By Theorems S^l and E^l CON(M) holds. Moreover, since 21 ^ (/>, then 
PREB-Atom0(A/) holds. This completes the proof of our proposition. 



H The details for the proof of Proposition 18.1 



The formal proof is as follows. Recall that V = {Pi,P2, . . .} be set of unary predicates used 
in 0. Abusing the notation, we let PREB^ itself to denote the set {n \ PREB(^(n) holds}. We 
claim that PREB,^ = Spec((/)). 

We first show the C direction. Let A^ G PREB^. Let M = {Mt^j^, . . . ,Mt„j^) be the 
witnesses to X such that PREB^(A^) holds. In the following we are going to write Mt to 
denote {Mtjj, ■ ■ ■ , Mtj^) for every type T G T^. 

By definition N = X]/y f\ M/tj)- We take a set V of N vertices and we partition V = 
V(^Ti,fi) U • • • U V^Tnjm) such that |V(yj)| = M(^tj) ^^r each T G T^ and f £ F. We denote by 
Vt = V(Tj^) U • • • U V(^Tjm) ^°^ each T G T^. 

Now since CON(M) holds, by Theorems 17.21 for each T G T,/,, there exists a {Dt,l)t)- 
directed-regular-complete graph Gt = {Vt, Rt,i, ■ ■ ■ , Rt/) of size Mr, with Vt = V(tj^)U- • -U 
VfTjm) ^^ ^^e partition of (L)^, D7^)-regularity. This means that for every vertex v G Vtj^, 
for every P G {Pi, . . . , Ri}, 

• out-deg^X^;) in the graph Gt is fi{T, R,T); 

• m-degji{v) in the graph Gt is fi{T, R,T). 

Now let Gt = {Vt, Pt,i, • • • , Rt/, Rt,i, ■ ■ ■ , RT,e) be the graph obtained by taking Pj as the 
reverse of Pj. Hence, we have for each vertex v (zVt, 
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• out-degpfv) = in-deg^(v) in the graph Gt] 

it 

• in-degn.(u) = out-deg^(i)) in the graph Gt- 

Jx 

Similarly, by Theorem l5.2l for each Tj, Tj G T^, where j < i— 1, there exists a [Dt^-^Tj , T^Ti~^Tj )- 
biregular-complete graph 

GTi,Tj = (VTi, VTj , RTi,Tj,l, ■ ■ ■ , RTi,Tj,e, RTi,Tj,l, ■ ■ ■ , RTi,Tj/) 

of size {Ms, Mt), with Vri = Vf^Tiji)^' ' -^^{Tijr^) and Vtj = V(r^. jj)U- ■ ■UV(_t,,u) be the parti- 
tion of [Dt^^Tj , ^Ti-^Tj )-biregularity. This means that for every R G {i?i, . . . , Ri, Ri, . . . , Re}, 

• for every vertex v G VXij, out-degj:j(t;) in the graph Gt^^Tj is f{Ti,R,Tj); 

• for every vertex v £ VtjJ, out-deg^(t;) in the graph GTi,Tj is f{Ti, R,Tj). 

Then, we put orientation in all the edges in the graph Gt^ t going from Vy. to Vt ■ And now 
let GTi,Tj be the graph adding the reverse edges from Vt; to Vr^ by putting {u,v) into R in 
the graph GTi,Tj whenever {v,u) G R{GTi,Tj) for each R gTZ. 
Hence, we have for each vertex v G Vy. U Vr , for each R € TZ 

• out-degR(v) = in-deg%(w) in the graph Gt, t,-; 

R ' ■' 

• in-degn.(u) = out-deg^(i)) in the graph Gt. t,-- 

R ' ■' 

Let G be the combination of all the graphs G = (F, i?i, . . . , Rn, Ri, . . . , Re), where for 
each R gTZ, 

R = [Jr{Gt) U U R(.Gt,,t,) 

T T„Tj 

Moreover, we also label each vertex v £ V with a subset of S as follows. For each T G T<^, 
for each v a Vt, we "declare" that v is labeled with a unary predicate P G P if and only if 
PeV. 

We claim that G \= (j). For that it is sufficient to show that for each T G T<^, for each 
V G Vt, typeQ{v) = T. The proof is divided into three cases. 

• For each unary predicate P G P, it is by our labelling of the vertices of G that P{v) 
holds in G if and only if P G T. 

• For each 0^ M G T, where R £ TZ we have 

Y, f{T,R,T') > I 

T' s.t. T'Bfi 

number of outgoing i?-edges from v. Since every function / G J^ is consistent, 0/j fJ- S 
type(t;). 

• Similary, for each 0^ fJ, ^ T, and hence "■(O^j /u) G T, where R £ TZ we have 

Y, f{T,R,T') > I 

T' s.t. T'3/i 

number of outgoing i?-edges from v. Since every function f £ T is consistent, 0/j fJ- £ 
type(v). 
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Therefore the graph G \= (j), and hence N £ Spec(0). 

Now we prove the direction D. Suppose 21 \= (j)is of size A''. Let M = {M^rpiji)^ • • • ) ^{T„jm,)) 
where Mirpj\ be the number of elements of type T from which there exist /(T, i?, S) number 
of outgoing i?-edges towards the elements of type S. Take each M(yj) to be the witness for 
X(T,f) for each T € T,/, and f € J-". It immediately follows from Theorems 17.21 and 15.21 that 
CON(iV, M) holds. Moreover, since ^\= (f), then PREB-Atom<^(M) holds. This completes the 
proof of our proposition. 
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